GPT-5: "How many times does the letter b appear in blueberry?"
GPT-5: "How many times does the letter b appear in blueberry?"
kieranhealy.org
Blueberry Hill
10 comments
-
-
Bluebberry
-
Bluebebry
-
-
oh no, gpt5? I thought the hype was finally coming to its senses...
-
b l u e b b e e r r y
-
I am never convinced they don't have in their user setting something like "fight back on spelling things wrong."
For the record I don't trust the damned thing but I have never had counting issues like that. At least not ones it would fight over.
-
Blueberry. B in positions 1, 5, and 7.
-
-
And when I tried this exact same test with Kimi K2, it did it perfectly with blueberry and strawberry
10 comments
i don't trust this fucken thing
No no, here's the thing. You need to correctly engineer your prompt to optimize your tokens and avoid aliasing...
/s
I don't either. I'll leave it to everyone else to decide on which end of the spectrum I fall