It's nothing to do with religion. When you fetishise identities you don't belong to, it can be helpful to listen to people who belong to those identities, so you can fetishise us respectfully. Otherwise you'd be talking about having sex with people you won't respect, which I'm sure you don't want to do.