Skip Navigation

Second week, first small outage

Hi peeps, if you're in Europe you might have noticed we had a small outage today. If you're in Europe, you might also have noted that it's hot outside. The PornLemmy team squeezes the servers running the site between a shit ton of other servers that do sciency stuff, but they're not critical enough to merit a nuclear fallout end of the world datacenter. Therefore, we get a regular run of the mill datacenter, which was not built with the tolerances this Cerberus heatwave is bringing down on us (and we're in the worst affected part of Europe).

So, because of the red temperature alert, hardware parts have started to degrade. We managed to do a database dump and move the whole deployment to another cluster without losing much data (about 10-15 minutes worth), but things are not looking good for the near future, as we have the red temperature alert predicted for every day this week and next week. Fun times ahead. Help us buy a desk fan?

Our apologies to anyone who was affected, and apologies in advance to anyone who might be affected in the future. We'd like to say we'll be on top of everything, but the weather is too freakish for us to actually believe it.

0
0 comments