I moved to a place 5 miles from where I grew up, which was and is rarely visited by anyone I grew up with, mainly due to both places going to totally different schools, playing in different football leagues etc. (just across county borders)
Despite over the past couple of decades all the old estates being levelled and huge amounts of investment being put in, most people I know are still like 'why do you live there, proper ****hole that'. Most of them do live in genuine dives where house prices are between 50%-75% of what they are here and have probably set foot here no more than twice in their lives.
Reputations take a long time to shake off.
Edit: actually to give a bit more detail, where I now live used to be a miners village. This is obviously going back a long time, I've no doubt the place was a proper **** hole back then, but the mine shut some time in the 1920's, so this reputation it has has lingered from probably great great grandparents to my generation and is still going strong today.
The village now has the highest council tax rate out of any town or village in the parish/borough/district whatever it is.
And this is a reputation that has survived as close as 5 miles down the road, Hull has this reputation around the entire country, and people will say things and others will believe it, and on and on it will continue.