I can't remember if this was said to me or if I overheard it. Maybe I'm fabricating the memory entirely, but in any case, I recall a conversation where someone said almost exactly what you did in that last sentence. The reply was of course
"Well someone always gets hurt."
"What do you mean?"
"It costs someone money to put those bathrooms in."
Wait, did they think the bathrooms were special and cost money? Many places just slap a paper “gender neutral” sign on their washrooms and call it a day until a nicer sign can come in. The really good places knew this shit ages ago and already saved themselves the trouble by putting in a shared sink area and having stalls with real doors. As someone who has literally had to fit washrooms into floor plans I can guarantee that if cost and ease were problems then we’d only have gender neutral washrooms.