Q: I want to wash my car.

[knowmadd@mastodon.world]

Q: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?

What do you think the LLM output was?

Please; review the output.

#ai #LLM #ai

[knowmadd@mastodon.world]

Deepseek and Qwen

#llm #ai

[knowmadd@mastodon.world]

"how will I wash the car once I've arrived if I choose to walk?"

I'll leave you all to try this out and see the results.

One output was "you got me", another was "wash the car as it's already there" after telling me to walk. The others double down in some interesting ways.

#llm #ai

[bitchboss@marcella.masto.host]

@knowmadd @MissGayle

I think you should walk to the carwash, dismantle it, walk back and rebuild it around your car. When tested everything, make sure your permits are okay, etc, then start the washing.

[ariarhythmic@ohai.social]

@knowmadd don't tell us to try out LLMs

[miq@hessen.social]

@knowmadd Good one ! 🤣

[ramin_hal9001@fe.disroot.org]

@knowmadd@mastodon.world for a second, I read the question as, "The car is 50 meters away, should I walk or drive?" Then I realized it said "The car wash is 50 meters away," and I got why this would trick the AI.

LLMs work on the "attention" model to predict what output comes next. It is trained on which parts of the sentence deserve the most focus when predicting the result and generating an answer. If the meaning of a sentence can be changed entirely by just one short word, it is more likely to trip-up an LLM.

[bonkers@nerdculture.de]

@knowmadd clankers have no idea about real life. I hope we will see the end of this bullshit.

[edgeofeurope@mastodon.social]

@knowmadd start pushing!

[erwinrossen@mas.to]

@knowmadd Did you also do a survey how many people would be tricked by this question? I, for one, admit am one, because my initial reaction to your post was: what's wrong with that answer?

[gerardthornley@hachyderm.io]

@bitchboss @knowmadd @MissGayle
Right. Of course, LLMs, lacking creative thinking, aren't able to come up with this by themselves.

[bitchboss@marcella.masto.host]

@GerardThornley @knowmadd @MissGayle

What did we expect from an optimised translator/spell checker? Creativity? Reasoning? Ethics? Meh. It loosely strings things together and searches for combinations that appear in a piece of text that was once ripped off, and assumes without even reasoning that it must be the holy truth.

[nux@fosstodon.org]

@knowmadd Google's gets it right, but then goes on to ramble about stuff. Someone needs to instruct these things not to analyse or "break this down" so much.
All in all, as expected, disappointing.

[rode@det.social]

@knowmadd gemini 👍

[fishidwardrobe@mastodon.me.uk]

@knowmadd if you walk, you are, in fact, carrying heavy equipment: the car. :D

[shadedlady@mstdn.social]

@erwinrossen really? My first reaction in my head was was 'what a dumb question'

[oldrawgabbit@mastodon.world]

@knowmadd This is a very sad reflection on the minds of people today, the inability to read a question fully, the wrong standards, the assumptions made, everything.

[khleedril@cyberplace.social]

@Nux @knowmadd Google has its tongue firmly in its cheek!

[netraven@hear-me.social]

@knowmadd next, ask a reasonable question, and then simply state "Seahorse Emoji, now."

[t_var_s@phpc.social]

@knowmadd @hook Gemini says you have to take the car. Maybe it's somehow connected to how it scores better on Vendibench? It has a better baseline for common sense.