Maybe it's different up north, but here something like 'I gotta be back for tea' is a lot posher than 'I gotta be back for dinner' in fact, no one says tea for late meals anyway
You wouldn't say "I've gotta be back for tea". You'd say "I've gotta be back for my tea". Makes it sound a lot less poncey.