Turnitin, a service that checks papers for plagiarism, says its detection tool found millions of papers that may have a significant amount of AI-generated content.
I've actually started to recognize the pattern of if something is written in AI
It's hard to describe but it's like an uncanny valley of quality, like if someone uses flowery SAT words to juje up their paper's word count but somehow even more
It's like the writing will occasionally pause to comment on itself and the dramatic effect its trying to achieve
Yeah it's called bullshitting. It's the way lots of people are encouraged to write in high school when the goal is to see if the student can write a large amount of prose with minimal grammatical errors.
But once you get to post-secondary you are expected for your writing to actually have content and be fairly concise in expressing that content. And AI falls on its face trying to do that.
The LLM isn't really thinking, it is auto complete trained so the average person would be fooled thinking that text was produced by another human.
I'm not surprised it has flaws like that.
BTW here on Lenny there are communities with AI pictures. Someone created a similar community but with art created by humans.
While the AI results are very good, when you start looking and comparing it with non AI art, you start seeing that the AI while it is unique it still produces a cookie cutter results.
I have issue with using AI to write my resume. I just want it to clean up my grammar and maybe rephrase a few things just in a different way I wouldn't because I don't do the words real good. But I always end up with something that reads like I paid some influencer manager to write it. I write 90% of it myself so its all accurate and doesn't have AI errors. But it's just so obviously too good.
You are putting yourself down unnecessarily. You want your resume to talk you up. Whoever reads it is going to imagine that you embellished anyway. So if you just write it basically, they'll think you're unqualified or just don't understand how to write a resume.
Writing papers is archaic and needs to go. College education needs to move with the times. Useful in doctorate work but everything below it can be skipped.
I'm in software engineering. One would think that English would be a useless class for my major, yet at work I still have to write a lot of documents. Either preparing new features, explaining existing, writing instructions for others etc
BTW: with using AI to write essays, you generally have subject that is known and that many people write something similar, all of that was used to train it.
With technical writing you are generally describe something that is brand new and very unique so you won't be able to make AI write it for you.
When I was in college (2000-2004), we wrote our long papers on computers but we had what were called “blue books” for tests that were like mini notebooks. And many of the tests were basically, “Here is the topic. Write for up to an hour.”
And now my hand cramps if I write anything longer than a check. I can also type quickly enough that it basically matches the speed of my train of thoughts but actually writing cursive with a pen now, I get distracted and think, “Wait, how does a cursive capital ‘G’ go? Oh yeah. Hold on. What was I going to write?”
I pity the kids that have always typed for what their hands will go through on written tests
Yeah that's pretty funny given the circumstances. "Our AI found your AI." Cool, so maybe none of this is working as intended. I'd be willing to bet nothing changes but the punishments for students.
My junior year of high school, I had to take a summer math class. The teacher was super lazy (cool though) and gave us all the actual final with the answers as a study guide (multiple choice scantron). I mentioned, to my group of about 5 kids, that I was sure this was the actual final and I had a plan to write the answers down on a little piece of paper and hold up fingers casually so everyone could cheat. 1 for A, 2 for B, etc.
Sure enough, on test day, it was the exact same test. I told everyone to take their time, don’t turn it in early, and ffs don’t get too many right. Everyone followed directions… except one. The moment I got done listing off the answers he stood up, walked over all proud, slapped it on the teachers desk, and started to walk out of the class.
“Wait,” the teacher said, casually. They started to grade it. 100% correct.
“You’ve got a C in the class and you expect me to believe you finished first and with every problem correct?”
Murmurs and giggles filled the room and the teacher walked to the board. Wrote a question from the test on it and said, “solve it.”
I have it write all my emails. I’m so productive and everyone loves them. That or they’re also using ChatGPT, and it’s just two computers flattering each other.
I had it write an operation manual for a client I particularly hate. Told it to make it sound condescending by dumbing it down just to the point where I could deny it. The first few times it just sounded like a 5th grade teacher talking to a kid while in a bad mood, but eventually it figured out if it just repeated itself enough it got the effect I wanted.
Things like: user is to disconnect power before attempting to repair. It is vital that the step of disconnecting power before attempting to repair is carried out.
I'm also sent long gpt generated documents and I summarise them in bullet points with gpt 4. Truly the future we all imagined (I learnt to take extra time to write a FAQ as an introduction to anything I write specifically because I know that they will gpt through the document, so I provide that stuff in advance)
What kind of emails are you sending to what kind of people, and how frequently that AI increases your productivity? I don't think I ever have emails that AI could do better or faster, since it'd probably take longer to explain to the AI what I need it to write than to type it out myself. Then again I'm in an engineering setting and it's pretty much just numbers, confirmations, basic requests, and issue descriptions, IT tickets, mostly
Someone posted to the class discussion form with the bit about being an ai bot still included.
I wish it was a joke.
I didn't do great in that class, but it was me getting 70% for not wanting to try and explain a mathematically concept in 500 words! They won't take that away from me.
That's a good one. I once gave an assignment for students to write an original poem. One student submitted The Charge of the Light Brigade by Tennyson and claimed it was his own. These were middle school kids so he didn't realize how famous the poem is. This shit has been happening forever. LLMs are another phase in the never-ending arms race between teachers and students who want to cheat.