Imagine 2 runners racing. One can trip and fall, get up and still win. Faster but less stable. For real time signal processing you have to maintain a minimum clock or dropouts and artifacts will occur.
My guess is this has to do with core stability. Dropouts occur more easily on the newer chips because the cores behave more erratically, even though they’re faster overall.