How we discovered, and recovered from, Postgres corruption on the matrix.org homeserver
How we discovered, and recovered from, Postgres corruption on the matrix.org homeserver
matrix.org
How we discovered, and recovered from, Postgres corruption on the matrix.org homeserver
People might have seen strange behaviour on matrix.org accounts recently. This blog post does a great deep dive into what happened.
Thanks for the detailed write-up, I always "enjoy" reading postmortem reports with detail like these. I say "enjoy" as I enjoy reading about it, but I don't enjoy thinking about the stress it must have caused. Good job in getting it all sorted!