I was running into this a lot when I had gnome tweaks installed. After removing it all my problems with slowdowns "after x amount of uptime" went away.
It was to the point where moving my mouse would freeze videos and dragging windows around was like a slideshow