Study Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrong
Study Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrong
Researchers found that 52 percent of answers to programming questions generated by ChatGPT were incorrect.
You're viewing a single thread.
We need a comparison against an average coder. Some fucking baseline ffs.
2 0 Reply"Self driving cars will make the roads safer. They won't be drunk or tired or make a mistake."
Self driving cars start killing people.
"Yeah but how do they compare to the average human driver?"
Goal post moving.
8 0 ReplyThe issue is the powers that be arent comparing chatgpt to a reference manual. Rather another human being.
1 0 Reply
Why would we compare it against an average coder?
ChatGPT wants to be a coding aid/reference material. A better baseline would be the top rated answer for the question on stackoverflow or whether the answer exists on the first 3 Google search results.
5 0 ReplyOr a textbook's explanation
2 0 ReplyCause people arent looking at chatgpt as an accurate simple code generator, rather a junior dev.
1 0 Reply