I've never smelled chlorine or any other artificial chemicals in German tap water. It's often pretty hard, though, which is a bit of a pain for e.g. coffeemakers.
In Germany, chlorine is extremely rarely used, only if the water from the wells is possibly contaminated with bacteria or, temporarily, if there have been issues with the water tubes.
Especially in Spain, it's more common.