Assistants
Assistants
Assistants
Write everything in Rust, rustc will tell you what's wrong.
attached a debugger to the LLM
interpret the input
This reads like someone who has heard of these general concepts but doesn’t understand them.
But then again, I just imagined trying to be 100% accurate while still being concise, and I don’t think it’s possible.
It’s also not really clear what the dynamic is supposed to be here. Is the LLM supposed to be invoking the generated code through a separate entry point like a test suite, or is the developer launching the built app with a debugger attached and feeding a prompt to the LLM whenever an exception is thrown?
Neither one of those would really be “attaching a debugger to the LLM” though, and in either case it would be interpreting the output not the input.
So, as usual this might be a translation issue, but I wasn't aware that an attachment has a direction. The debugger would obviously feed its output to the llm in this scenario, so the two things are attached to each other in the sense of the word that I got from a dictionary. As the debugger gives a filename as well, feeding the files contents as well, asking for improvements and overwriting the original file would be trivial, so automating it should be easy enough. Attachment was meant here only in the sense of "well, they're connected and data goes from a to b".
Would such a setup make sense? Not really. But you know, that's why it's a four-panel-comic and not some overrated ai startup. Or maybe it is, it seems like making sense isn't really a requirement for tech startups anymore.
Ah. Definitely a translation issue. I didn’t realize there was a translation involved. Or that you were the author. I wouldn’t have been so critical otherwise. You’re doing great.
“Attachment” in general doesn’t have a direction, but in the context of “attach debugger”, it does, because the target of the attachment is the process you want to inspect. In this case, the process is the code you’re writing, not the LLM helping you write it.
That is so dark.
C is easy ! Just don't make any mistake :)
Syntax errors != Logic errors
There are absolutely people that believe if you tell ChatGPT not to make mistakes that the output is more accurate 😩.. it’s things like this where I kinda hate what Apple and Steve Jobs did by making tech more accessible to the masses
Well, you can get it to output better math by telling it to take a breathe first. It's stupid but LLMS got trained on human data, so it's only fair that it mimics human output
The theory behind this trick is that you are refining the part of its knowledge base it'll use. You are basically saying "most of the examples you were trained on was written by idiots and is full of mistakes, so when you answer my query limit yourself to the examples that have no mistakes". It sounds stupid but apparently, to some extent, it kind of works?
Whilst I’ve avoided LLMs mostly so far, seems like that should actually work a bit. LLMs are imitating us, and if you warn a human to be extra careful they will try to be more careful (usually), so an llm should have internalised that behaviour. That doesn’t mean they’ll be much more accurate though. Maybe they’d be less likely to output humanlike mistakes on purpose? Wouldn’t help much with llm-like mistakes that they’re making all on their own though.
You are absolutely correct and 10 seconds of Google searching will show that this is the case.
You get a small boost by asking it to be careful or telling it that it's an expert in the subject matter. on the "thinking" models they can even chain together post review steps.