Stubsack: weekly thread for sneers not worth an entire post, week ending 25th May 2025
Sailor Sega Saturn @ sailor_sega_saturn @awful.systems Posts 7Comments 650Joined 2 yr. ago

Sailor Sega Saturn @ sailor_sega_saturn @awful.systems
Posts
7
Comments
650
Joined
2 yr. ago
Yeah that jumped out to me. Like human teaching has scaled fine to billions of people. It certainly has a better track record than Duolingo which provides meh study material and leads to ahem mixed learning outcomes despite being around for over a decade.
Of course there's the subtext of "but also we'll be able to put all those obsolete teachers out of business and make tons of money!"
Being in tech I definitely see misuse of A/B testing sometimes. Sometimes a team will ignore common sense entirely but come up with metrics that measure something irrelevant. The metrics are, intentionally or not, gamed to tell them what they want to hear. They then run the (useless) numbers and use that to justify why their change was good, even in the face of intense user backlash.
One particular example that just came to mind: someone made a bad change, and lots of people complained. Eventually the complaints started to peter out. Then they claimed "see! people just had to get used to it!" (versus the rather more obvious possibility that nobody bothered to complain more than once).