Siri Is Super Dumb and Getting Dumber | John Gruber's Daring Fireball, Jan '25 -- Siri gets 15 Super Bowl winners wrong in a row; Apple's ChatGPT integration shockingly neutered
Siri Is Super Dumb and Getting Dumber | John Gruber's Daring Fireball, Jan '25 -- Siri gets 15 Super Bowl winners wrong in a row; Apple's ChatGPT integration shockingly neutered
Siri with Apple Intelligence gives confident but embarrasingly wrong answers to sports trivia questions, both famous (Super Bowls) and obscure (North Dakota high school hoops).
& Kagi (search company w/controversial CEO) sounds like they're doing something right
Excerpt:
...Paul Kafasis...took it and pursued it thoroughly, asking Siri “Who won Super Bowl __?” for every number from 1 through 60.
His report at One Foot Tsunami documenting the results is utterly damning:
So, how did Siri do? With the absolute most charitable interpretation, Siri correctly provided the winner of just 20 of the 58 Super Bowls that have been played. That’s an absolutely abysmal 34% completion percentage. If Siri were a quarterback, it would be drummed out of the NFL.
Siri did once manage to get four years in a row correct (Super Bowls IX through XII), but only if we give it credit for providing the right answer for the wrong reason. More realistically, it thrice correctly answered three in a row (Super Bowls V through VII, XXXV through XXVII, and LVII through LIX). At its worst, it got an amazing 15 in a row wrong (Super Bowls XVII through XXXII). Most amusingly, it credited the Philadelphia Eagles with an astonishing 33 Super Bowl wins they haven’t earned, to go with the 1 they have.
Below, I’ve gathered a dozen of my favorite responses, in sequential order.
You're viewing a single thread.
@parody you’re the lucky one because you use Siri in English, I guess. And then the results are deplorable. But, if you use Siri in other languages, say German (spoken by 130 million people) or Dutch (spoken by 25 million people) the results are totally useless or -even worse - completely wrong.
If it wouldn’t be Apple, the efforts would be endearing. But it’s about Apple, so it’s annoying and to the level of totally unbelievable that they messed up so badly.
Be lucky that at leats you have Apple devices with your language support.