Is that a problem?
The affordability crisis in the first half of the 20th century saw people leave their unaffordable homes for affordable places like Toronto. Their home regions unquestionably suffered for it, but Toronto was able to flourish because of it.
Maybe it's okay to see new places get their turn? After all, Toronto would just be a poduck town if such movement never happens. Did nothing good come of Toronto's massive growth?