People just don't go to other people saying some random shit where I'm from. Unless they're crazy, beggars, or tourists from the US. If you come to anorher person and don't start your sentence with "excuse me" or "sorry", you're getting ignored.
That’s because it’s a straw-man. Unless someone has serious social deficiencies, this doesn’t happen. The experience is 99% ignore, 0.9% might get “like your shirt”, or “cool band”, 0.1% some weirdo - who would have found something else anyway if it wasn’t your shirt.
It’s a type of negging. I can guarantee you women wearing band shirts riding a subway, at a bar, etc, have been asked this kind of question with negative ulterior motives.