The exception to this is if there is a divider in the middle of the road, for example a curb or island.
A couple times I've seen firetrucks drive over the median to the other side of the road if traffic is backed up so you should still be cautious if you are on the opposite side of the median.