Why does the winter solstice mark the beginning of winter, and not the center?

I'd expect the shortest day of the year to also be the coldest, with the coldest season of the year spreading out equally on both sides of it.