What you call Byzantine empire didn't exist as such, they actually referred to themselves Romans. Byzantine Empire is a later term https://byzantinemporia.com/why-is-byzantium-called-byzantine/.
The reference of Eastern Roman Empire is correct, everyone else who claimed to be a continuation is just a stretch though.
I don't think that is crucial as you think, unless the safety driver dragged the passenger around..