Begrudgingly Yeast (@begrudginglyyeast.bsky.social) on bsky informed me that I should read this short story called 'Death and the Gorgon' by Greg Egan as he has a good handle on the subjects/subjects we talk about. We have talked about Greg before on Reddit.
I was glad I did, so going to suggest that more people he do it. The only complaint you can have is that it gives no real 'steelman' airtime to the subjects/subjects it is being negative about. But well, he doesn't have to, he isn't the guardian. Anyway, not going to spoil it, best to just give it a read.
I love this. Especially the ending, talking about the titanic struggle to make AI competent enough to outsmart the people who think it's going to be omniscient. Glad to see I've got another writer to chase down that I had somehow missed previously.
Yeah, and despite me being quite anti LLMs, I did like how he didn't make them useless, fits nicely with the story, also allowed the great ending line.