What makes you think it's the building naming the cheese and not the cheese naming the building? Why can't we live in roqueforts, in masdaams, in cheddars?
I was going to joke that Id prefer to live in a Jarlsberg, but when looking up Jarlsberg to spell it correctly I discovered its named for Jarlsberg Manor, which is (and this is true) a building
Or Gouda. For extra fun while you're there, pronounce Gouda the way it's typically said in English and watch the Dutchies flinch as little parts of their soul leave their bodies.
You know how we say that Mushrooms are the largest organisms on earth, because the Mycelium is interconnecting all through the forest and we only see the fruiting bodies?
Well, most reasonably modern towns have all their buildings connected by the fresh water and sewage pipes and possibly gas-pipes. I'll exclude electricity, because the cables don't really have a volume they enclose.
So you could argue that most towns in Europe are indeed a building.