Under-qualified sysadmin crashed Amazon.com for 3 hours
Under-qualified sysadmin crashed Amazon.com for 3 hours
www.theregister.com
Under-qualified sysadmin crashed Amazon.com for 3 hours
Who, Me?: 'This, many considered, was bad'
14 comments
-
-
I’ve been a professional programmer for 19 years this year, and I caused 3-hour data loss on one of our major apps just the other week. Shit happens. Humans make errors; even experienced ones. We should strive to learn from it.
As they say:
Biting your tongue while eating is the perfect example of how you can mess up even with decades of experience.
-
Biting your tongue while eating is the perfect example of how you can mess up even with decades of experience.
Should have setup a staging enviroment and tasted there first before diving in. \s
-
Question: is the \s a Windows version of /s?
-
-
-
Or as we say in networking: "You're not one of us until you caused your first major outage".
(edit: typo)
-
Yeah I threw like 1 week of email into a black hole unknowingly.
Instead of multiple shared mailboxes for different emails they used a master shared mailbox with a bunch of DLs all pointed to it.
The DLs were just single email contact to the one master mailbox.
Well I reinstalled Azure AD Connect (no backuo config) and didn't check off the damn contacts OU.
ALL THE EMAIL WENT TO A BLACK HOLE
After fixing the issue the email was still gone. Thankfully they had an antispam proxy service that kept a copy of all email. I restored all the aliases by resending. Managed to recover sales@company.com emails and the like.
It was the most idiotic design I've ever seen. No RBAC. Everyone just had access to "the mailbox" and they had mail filters to put it in folders. They had 3k employees too. Not a mom and pop shop at all.
I feel like some C-suite complained about "too many mailboxes" and the sysadmin "fixed it".
That person should be shot. Just because you can doesn't mean you should.
-
-
Hehe. The manager troll was perfect.
-
It's one thing to be known as the guy that crashed Amazon, it's another to be known as the "Under Qualified" guy that crashed Amazon
14 comments
20 years ago. That should have been in the headline.
20 years ago? Shit, that was nothing compared to modern day amazon.
Eh, that assumes that all posts are news posts. When I first saw this headline I didn't assume it was current news, but I'm also familiar with the "Who, Me?" column I guess.
In communities like this, yes, it's generally assumed that it's current events.