Study Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrong

Researchers found that 52 percent of answers to programming questions generated by ChatGPT were incorrect.

You're viewing a single thread.

125 comments

I use chatgpt semi-often... For generating stuff in a repeating pattern. Any time I have used it to make code, I don't save any time because I have to debug most of the generated code anyway. My main use case lately is making python dicts with empty keys (e.g. key1, key2... becomes "key1": "", "key2": "",...) or making a gold/prod level SQL view by passing in the backend names and frontend names (e.g. value_1, value_2... Value 1, Value 2,... Becomes value_1 as Value 1,...).
- I know this is gonna sound annoying but I just use vim for stuff like this. Even notepad++ has a macro thing too, right? My coworkers keep saying how much of a productivity boost it is but all I see it do is mess up stuff like this that only takes a few seconds in vim to setup and I know it'll be correct every time
  
  I use vim keybinds (via doom emacs) for this sort of stuff if I'm doing it for personal projects, my professional work is all done in an online platform (no way around it) so it's just faster and easier to throw the pattern and columns at the integrated chatgpt terminal rather than hop to a local editor and back

125 comments