Inside the Secret Meeting Where Mathematicians Struggled to Outsmart AI

Most of their quotes come from this Ono guy...

Ono, who is also a freelance mathematical consultant for Epoch AI.

Ahhh, there it is.

So a company that is known for cheating on benchmarks to look better organises a benchmark and surprisingly passes it flawlessly.... I am shocked!

This shits so stupid. LLMs aren't good at math. They aren't meant to be good at math. Stop trying to trick us into thinking theyre good at math. Use them for what theyre meant to do. Good Christ.

And not a single research paper was linked.

“I came up with a problem which experts in my field would recognize as an open question in number theory—a good Ph.D.-level problem,” he says. He asked o4-mini to solve the question. Over the next 10 minutes, Ono watched in stunned silence as the bot unfurled a solution in real time, showing its reasoning process along the way.

Ok cool story, hypeman. Well what was this problem then? Has it shook up the world of number theory? lol these grifters. jfc.