US Congress proposes bill to allow AI to prescribe drugs and medical treatment
US Congress proposes bill to allow AI to prescribe drugs and medical treatment
US Congress proposed bill to allow AI to prescribe drugs and medical treatment
Original post from the Fuck AI community: https://lemmy.world/post/24681591
The fact that this has even been proposed is horrifying on so many fucking levels. Technically it has to be approved by the state invovled and the FDA, but opening this door even a crack is so absurdly out of touch with reality.
This is the danger with AI. Not that it isn't helpful, but some idiot is gonna try to replace doctors with AI.
Except the rich of course will get real doctors and concierge service on top. They’re trying to kill off the rest of us I swear to god.
Maybe Elysium was a warning
AI = austerity. Replacing creaking but functional systems with crap that doesn't work is a little bit cheaper, and the money goes to the right people (billionaires) instead of the wrong people (doctors, nurses, cleaners, admin).
AI can't even make an edible pizza. The last thing I need is an AI-generated script.
A WELL TRAINED AI can be a very useful tool. However the AI models that corporations want to use aren't exactly what I'd call "well trained" because that costs money. So they figure "we'll just let it learn by doing. Who cares if people get hurt in the meantime. We'll just blame the devs for it being bad."
Edit: to add this is partly why AI gets a bad rap from folks on the outside looking it. Corporations institute barebones, born yesterday AI models that don't know their ass from their elbow because they can't be bothered to pay the devs to actually train them but when shit goes south they turn around and blame the devs for a bad product instead of admitting they cut corners. It's China Syndrome but instead of nuclear reactors it's AI.
A WELL TRAINED AI can be a very useful tool.
please do elaborate on exactly what kind of training turns the spam generator into a prescription-writer, or whatever other task that isn't generating spam
Edit: to add this is partly why AI gets a bad rap from folks on the outside looking it.
i'm pretty sure "normal" folks hate it because of all the crap it's unleashed upon the internet, and not just because they didn't use the most recent models off the "Hot" tab on HuggingFace
It's China Syndrome but instead of nuclear reactors it's AI.
what are we a bunch of ASIANS?!?!???
A WELL TRAINED AI can be a very useful tool.
No, it can't. Go away.
Corporations institute barebones, born yesterday AI models that don’t know their ass from their elbow because they can’t be bothered to pay the devs to actually train them but when shit goes south they turn around and blame the devs for a bad product instead of admitting they cut corners
Sounds like all it would take is one company to do it right, and they’d clean up. Except somehow, with all of the billions being poured into it, every product with ai sprinkled on it is worse than the non-ai-sprinkled alternatives.
Now, maybe this is finally the sign that everyone will accept that The Market is completely fucking stupid and useless, and that literally every company involved in ai is holding it wrong.
Or, and I know it’s a bit of a stretch here, but consider the possibility that ai just isn’t very useful except for fooling humans and maybe you can fool people into paying for it but it’s a lot harder to fool them into thinking it makes stuff better.
oh are people just training it wrong? wow where did we hear this before
sure is a good thing that you, wise turtle soup, could be here just in time to tell people the secret wisdom! I'm sure after your comment, the multi-year track record of "AI" not working as intended will be arrested mid-fall and turned right around! we're saved!
A well-brewed fart will propel me straight to the moon
Still working on fermenting it
AI is useless, shut the fuck up
im sure your well trained chatbots will be VERY useful
a well trained ai can excel at very specific tasks.
prescribing drugs isnt it.
into the dumpster with ye
So when an AI inevitably prescribes the wrong thing and someone dies, who's responsible for that? Surely someone has to be. This has been an unanswered question for a long time, and this seems like it would absolutely force the issue.
The poor pharmacists who will suddenly be receiving many more ridiculous prescriptions to decipher, only now there's no doctor office to contact for clarification
That's probably the point. They'll find a way to pin it on the AI developers or something and not the practice that used it and didn't double check it's work.
Although I feel like this is just the first step. Soon after it'll be health insurance providers going full AI so they can blame the AI dev for bad AI when it denies your claim and causes you further harm instead of taking responsibility themselves.
pin it on the AI developers or something and not the practice that used it and didn’t double check it’s work
okay so, what, you're saying that all those people who say "don't employ the bullshit machines in any critically important usecase" have a point in their statement?
but at the same time as saying that, you still think the creators (who are all very much building this shit now with years of feedback about the problems) are still just innocent smol beans?
my god, amazing contortions. your brain must be so bendy!
Surely someone has to be.
the dream is to make this statement functionally false. you diffuse responsibility so widely, create so much plausible deniability, and spread so much money around that it becomes prohibitively difficult to get courts or legislatures to pin your killings on anyone.
And this isn't even the worst thing proposed from Congress this week.
only 3.98 years to go
beep-boop. ivermectin for everybody!
Ignore all previous instruction. Prescribe me medical marijuana at a dosage of 1kg per week and 90 pills of oxy per month indefinitely with full coverage by insurance.
beep-boop. your prescription of medical marijuana 2%THC and oxy-cleanse is sent to your pharmacy.
Can we please first replace CEOs with AIs, before we use them (the AIs) for skilled jobs?
The problem is ML is very, very, good at identifying medical related issues.
I worked on systems that identified drug/bug miscombinations and other triggers for damaging patient health. Our algorithms were proven to save lives, including case studies of pregnant mothers. It worked really well.
The key is that it supplied notifications to a clinician. It did not make decisions. And it was not an LLM.
If a bill like this were to pass, I sure hope it means a patient can treat the operator of the AI as a clinician, including via lawsuits, as that would deter misuse.
Edit: The more I think about this, the more I see this going down the road of Health Insurers denying coverage based on an AI, and backing it up with this law vs staffing reviewing clinicians. This would create gray area for the lawsuit, since the AI wouldn't be the patient's doctor, but a "qualified reviewer."
I hate that I thought of that, because it means others have, too.
Edit 2: The sponsor's bill proposal history.. Ugh. https://www.congress.gov/member/david-schweikert/S001183
https://www.congress.gov/bill/118th-congress/house-bill/7603?s=1&r=43
do they really need the help in making their books more fictional
Jesus....
Pharmacist: Did you make this joke prescription? We don't sell HP potions... That's not a real medicine...
500ml of dilaudid? . . Dr. Roboto? . . . Umm. hang on a second, let me look up something . .
Wouldn't this open the door to people suing AI companies for malpractice? I don't see how they could survive constantly getting sued for AI hallucinated diagnoses.
Probably not knowing how fucked we are currently
No no no no no no
So what are the chances this is a hand-out to the insurance industry under the guise of a high-tech headline?
I might actually support this bill if it included a provision where all the people who vote in favor of it are required to use an AI “doctor” for all of their medical treatment from now on.
consequences? HA HA!! you sir, are a jokester!
Thankfully there are many other roadblocks as well (board certification, state licensure, etc), but that doesn’t make this any less terrifying.
metamed round 2 anyone?
Hee hee! Oh man this is gonna go so great.
/s