Well, that's what happens when you hyperbolically mislabel your political opponents as Nazis. Suddenly, half the country is Nazis because they don't want unlimited and unfiltered immigration.
If people accuse you of being a nazi, you either are one or you associate with them
That being said, I wouldn't call present day Republicans nazis. That's a very specific brand. Wannabe fascists and totalitarians on the other hand, definitely. And not because of their stance on immigration.