Using this approach, I've now turned on automatic scanning of new uploads.
What this means for you is that occasionally you will upload an image for a post and it will stop working after a bit. C'est la vie. Just upload something else. Changing format or slightly altering the image won't help you.
Also, sometimes you might see missing thumbnails on post from other communities. Those were the cached thumbnails hosted by us. The original images should still work in those cases.
Unfortunately this sort of AI scanning is not perfect and due to the nature of the beast, it will catch more false positives but to an acceptable degree. But I find that this is OK for a small social network site run as a hobby project.
Catch and hunt these degenerates. I'd hope law enforcement would get involved. If these sick fucks have these images and have posted them hopefully they can track them and imprison them
This is perfect moment / place for interpol and other organizations to catch some pedo mother fuckers . Those people are absolute human trash. Also Expect heavy vigilance from big eyes over the fediverse.
and due to the nature of the beast, it will catch more false positives but to an acceptable degree
What is this "acceptable degree"? Where is it documented?
What is the recourse for the uploader in case of a false positive? And no I don't mean "upload something else", I mean what do you answer to "my legit content is being classified by a shared internet tool as CSAM, of all things".