Q: I want to wash my car.

[ramin_hal9001@fe.disroot.org]

@knowmadd@mastodon.world for a second, I read the question as, "The car is 50 meters away, should I walk or drive?" Then I realized it said "The car wash is 50 meters away," and I got why this would trick the AI.

LLMs work on the "attention" model to predict what output comes next. It is trained on which parts of the sentence deserve the most focus when predicting the result and generating an answer. If the meaning of a sentence can be changed entirely by just one short word, it is more likely to trip-up an LLM.

[bonkers@nerdculture.de]

@knowmadd clankers have no idea about real life. I hope we will see the end of this bullshit.

[edgeofeurope@mastodon.social]

@knowmadd start pushing!

[erwinrossen@mas.to]

@knowmadd Did you also do a survey how many people would be tricked by this question? I, for one, admit am one, because my initial reaction to your post was: what's wrong with that answer?

[gerardthornley@hachyderm.io]

@bitchboss @knowmadd @MissGayle
Right. Of course, LLMs, lacking creative thinking, aren't able to come up with this by themselves.

[bitchboss@marcella.masto.host]

@GerardThornley @knowmadd @MissGayle

What did we expect from an optimised translator/spell checker? Creativity? Reasoning? Ethics? Meh. It loosely strings things together and searches for combinations that appear in a piece of text that was once ripped off, and assumes without even reasoning that it must be the holy truth.

[nux@fosstodon.org]

@knowmadd Google's gets it right, but then goes on to ramble about stuff. Someone needs to instruct these things not to analyse or "break this down" so much.
All in all, as expected, disappointing.

[rode@det.social]

@knowmadd gemini 👍

[fishidwardrobe@mastodon.me.uk]

@knowmadd if you walk, you are, in fact, carrying heavy equipment: the car. :D

[shadedlady@mstdn.social]

@erwinrossen really? My first reaction in my head was was 'what a dumb question'

[oldrawgabbit@mastodon.world]

@knowmadd This is a very sad reflection on the minds of people today, the inability to read a question fully, the wrong standards, the assumptions made, everything.

[khleedril@cyberplace.social]

@Nux @knowmadd Google has its tongue firmly in its cheek!

[netraven@hear-me.social]

@knowmadd next, ask a reasonable question, and then simply state "Seahorse Emoji, now."

[t_var_s@phpc.social]

@knowmadd @hook Gemini says you have to take the car. Maybe it's somehow connected to how it scores better on Vendibench? It has a better baseline for common sense.

[ecosdelfuturo@mstdn.social]

@knowmadd What I like most is that the Qwen website shows this little light bulb with the text “thinking completed.” :)

[themipper@mastodon.social]

@knowmadd yeah, LLMs will replace us all ... they are so much better at {looking frantically through my notes} ... providing answers with high confidence that are utter nonsense.

[roblen@microblog.at]

@knowmadd I tried to reproduce the result with Gemini and ChatGPT. Either the AI has learned something new, or there is another reason for this. Neither fell for the trick question and even responded with irony in some cases.

[nounoursfaisdeschoses@mastodon.social]

@knowmadd i got this : "Verdict: Walking is the best choice here—it’s quick, eco-friendly, and practical for such a short distance. Plus, you’ll avoid driving a dirty car to the car wash!"

[joonq@mastodon.social]

@knowmadd This is what techbros and pro AI people talk about like its the second comming of christ or something btw 😂 so cringe.

[azuaron@cyberpunk.lol]

@knowmadd Deepseek was so close. 😆