Maybe I'd be more interested in AI if there was any I with the A. At the moment, there's no more intelligence to these things than there is in a parrot with brain damage, or a human child. Language Models can mimic speech but are unable to formulate any original thoughts. Until they can, they aren't AI and I won't be the slightest bit interested beyond trying to break them into being slightly dirty (and therefore slightly funny).
Just so you know I totally agree with you but if you go far back enough in my comment history I had a really interesting (imo) discussion/argument with someone abt this very topic and the topic of how to determine if an AI 'thinks' or 'reasons' more broadly.