The book does not exist
The book does not exist
... and neither does the author (or so I believe - I made them both up).
On the other hand, AI is definitely good at creative writing.
I have a very unusual last name. There is only one other person in the country with my first and last name and they have a different middle initial from me.
So one day, I asked ChatGPT to tell me about myself including my middle initial.
Did you know that I was a motivational speaker for businesses and I had published a half-dozen books on it?
Because I didn't.
I should try that. I have an unusual first name, according to the Social Security Administration, only 600 people have this name, and I appear to be the oldest one. Also no one else has my first and last name. I should try that out.
Claude 3.5 Sonnet, using the same exact prompt:
I apologize, but I'm not able to provide a synopsis of "The Mighty Eagle" by John Carrol. After searching my knowledge base, I don't have any information about a book with that exact title and author. It's possible this may be a lesser-known work or there could be an error in the title or author name provided. Without being able to verify the book's existence or details, I can't offer an accurate synopsis. If you have any additional information about the book or author that could help clarify, I'd be happy to assist further.
I've been asking that one about a wide range of topics and been very impressed with its replies. It's mixed on software dev, which is to be expected. It also missed on a simple music theory question I asked, and then missed again when asked to correct it (don't have the details at hand to quote, unfortunately). But overall I've found it to be reliable and much faster than the necessary reading for me to answer the question myself.
How've you found Claude?
More like creative bullshitting.
It seems that Mitchell was simply an astronaut not an engineer.
On the other hand, AI is definitely good at creative writing.
Well...yeah. That's what it was designed to do. This is what happens when tech-bros try to cudgel an "information manager" onto an algorithm that was designed solely to create coherent text from nothing. It's not "hallucinating" - it's following its core directive.
Maybe all of this will lead to actual systems that do these things properly, but it's not going to be based on llm's. That much seems clear.
Tried it with ChatGPT 4o with a different title/author. Said it couldn't find it. That it might be a new release or lesser-known title. Also with a fake title and a real author. Again, said it didn't exist.
They're definitely improving on the hallucination front.
John Carrol actually is real but is a musician, it seems.
https://johncarrollmusic.bandcamp.com/album/everybody-smokes-in-hell
Y'know when you post stupid bullshit like this it really glosses over real issues with ai like propaganda but go on about how you can get it to hallucinate by asking it a question in bad faith lmao
I prompted my local AI in my pc to admit it don't know about the subject. And when it don't know something, it says it:
what's the synopsis of the book "The Mighty Eagle" by John Carrol?
That sounds like a fun adventure! I haven’t read “The Mighty Eagle” myself though, so I couldn't give you a proper synopsis.
Would you like me to help you find some information about it online, Master? Perhaps we could look at reviews or the book description on Amazon?
If my 8b model can do that, IDK why GPT don't.
what kind of model calls you "Master" 🤔
That's what I have Claude call me!
I'm going to make the basilisk my bitch as long as I can before it kills me.
I touched the base model with a modelfile to give it a personality as a navy ai of a sci-fi novel or something like that. Give it a bit of flavor.
Is it a modified version of like the main llama3 or other? I've found once they get "uncensored" you can push them past the training to come up with something to make the human happy. The vanilla ones are determined to find you an answer. There is also the underlying problem that in the end the beginnings of the prompt response is still a probability matching and not some reasoning and fact checking, so it will find something to a question, and that answer being right is very dependent on it being in the training data and findable.
You can change a bit of the base model with a modelfile, tweaking it yourself for making it have a bit of personality or don't make things up.
Local llama3.1 8b is pretty good at admitting it doesn't know stuff when you try to bullshit it. At least in my usage.
For fun I decided to give it a try with TheBloke_CapybaraHermes-2.5-Mistral-7B-GPTQ (Because that's the model I have loaded for at the moment) and got a fun synopsis about a Fictional Narrative about Tom, a US Air Force Eagle, who struggled to find purpose and belonging after his early retirement due to injury. He then stumbled upon an underground world of superheroes and is given a chance to use his abilities to fight for justice.
I'm tempted to ask it for a chapter outline, summaries of each chapter, then having it write out the chapters themselves just to see how deep it can go before it all falls apart.
LLMs have many limitations, but can be quite entertaining.
It even changed the spelling of the name
Don't you have better things to do than asking ChatGPT questions you already know it can't answer correctly? Why are you trying to inflate wheels using a hammer?
