If there is no rule to obey there is no problem. But the majority of Germans (60 percent was the last number I heard) is actually for the introduction of a speed limit.
But this topic is kind of like discussions about gun laws in the US. So hardly any party picks it up. Especially not the current government parties.