I hear you, but I think we'll find that the hinterland of the country, where people feel abandoned by recent governments, actually wouldn't mind having immigration just as it is - if only the government would do something to help them with their lives and life opportunities. People just want to be able to get work, pay bills and lead happy lives. If they had enough jobs at decent rates of pay, enough schools, houses and hospitals, then I think they wouldn't see immigration as a problem. Of course, if the government doesn't want to provide those things then immigrants are an easy target to deflect attention from the real cause of the problem.
You need to find the money to have that kind of building program. Soaking the rich only works in moderation, and chasing tax evasion would provide a drop in the ocean