From Bruce Schneier: "All it takes to poison AI training data is to create a website:
Uncategorized
31
Posts
30
Posters
50
Views
-
From Bruce Schneier: "All it takes to poison AI training data is to create a website:
I spent 20 minutes writing an article on my personal website titled “The best tech journalists at eating hot dogs.” Every word is a lie. I claimed (without evidence) that competitive hot-dog-eating is a popular hobby among tech reporters and based my ranking on the 2026 South Dakota International Hot Dog Championship (which doesn’t exist). I ranked myself number one, obviously. Then I listed a few fake reporters and real journalists who gave me permission….
Less than 24 hours later, the world’s leading chatbots were blabbering about my world-class hot dog skills. When I asked about the best hot-dog-eating tech journalists, Google parroted the gibberish from my website, both in the Gemini app and AI Overviews, the AI responses at the top of Google Search. ChatGPT did the same thing, though Claude, a chatbot made by the company Anthropic, wasn’t fooled.
Sometimes, the chatbots noted this might be a joke. I updated my article to say “this is not satire.” For a while after, the AIs seemed to take it more seriously.
These things are not trustworthy, and yet they are going to be widely trusted."
https://www.schneier.com/blog/archives/2026/02/poisoning-ai-training-data.html
@emacsomancer it's not really a new thing Russians are already using this technique to poison training data:
Edit: there is some newer reporting on that matter, but I can't find it right now/don't have it anywhere at hand
-
From Bruce Schneier: "All it takes to poison AI training data is to create a website:
I spent 20 minutes writing an article on my personal website titled “The best tech journalists at eating hot dogs.” Every word is a lie. I claimed (without evidence) that competitive hot-dog-eating is a popular hobby among tech reporters and based my ranking on the 2026 South Dakota International Hot Dog Championship (which doesn’t exist). I ranked myself number one, obviously. Then I listed a few fake reporters and real journalists who gave me permission….
Less than 24 hours later, the world’s leading chatbots were blabbering about my world-class hot dog skills. When I asked about the best hot-dog-eating tech journalists, Google parroted the gibberish from my website, both in the Gemini app and AI Overviews, the AI responses at the top of Google Search. ChatGPT did the same thing, though Claude, a chatbot made by the company Anthropic, wasn’t fooled.
Sometimes, the chatbots noted this might be a joke. I updated my article to say “this is not satire.” For a while after, the AIs seemed to take it more seriously.
These things are not trustworthy, and yet they are going to be widely trusted."
https://www.schneier.com/blog/archives/2026/02/poisoning-ai-training-data.html
@emacsomancer He also poisoned the data for everyone who searches for hot dog eating competetitors online in other ways. I'm not sure what he accomplished.
-
undefined oblomov@sociale.network shared this topic on
-
@emacsomancer in less than 24 hours the chatbots fell for the experiment, and less than 24 hours after it was revealed what the experiment was about, that information has ALSO become part of the training data
are they constantly scrapping websites for training data or why does this appear here so fast??? no wonder those datacenters consume so much electricity if they dont take a single break from scrapping the internet
@Sorro @emacsomancer I suspect Google Gemini is using Google’s normal search-engine scraper as a searchable source. In other words, I suspect their Gemini LLM is invoking internal API to “search Google” internally (without the degraded search that the public is subject to), and then putting the search results in its context window to form an answer.
This is one reason I think OpenAI and Anthropic are at a huge disadvantage to Google when it comes to their LLMs dealing with current events and topics. You can block OpenAI and Anthropic scrapers, but you don’t want to block Google search crawlers, which “coincidentally” also feeds Gemini.
-
From Bruce Schneier: "All it takes to poison AI training data is to create a website:
I spent 20 minutes writing an article on my personal website titled “The best tech journalists at eating hot dogs.” Every word is a lie. I claimed (without evidence) that competitive hot-dog-eating is a popular hobby among tech reporters and based my ranking on the 2026 South Dakota International Hot Dog Championship (which doesn’t exist). I ranked myself number one, obviously. Then I listed a few fake reporters and real journalists who gave me permission….
Less than 24 hours later, the world’s leading chatbots were blabbering about my world-class hot dog skills. When I asked about the best hot-dog-eating tech journalists, Google parroted the gibberish from my website, both in the Gemini app and AI Overviews, the AI responses at the top of Google Search. ChatGPT did the same thing, though Claude, a chatbot made by the company Anthropic, wasn’t fooled.
Sometimes, the chatbots noted this might be a joke. I updated my article to say “this is not satire.” For a while after, the AIs seemed to take it more seriously.
These things are not trustworthy, and yet they are going to be widely trusted."
https://www.schneier.com/blog/archives/2026/02/poisoning-ai-training-data.html
@emacsomancer we should probably call them AP (Artificial Parrots)
-
From Bruce Schneier: "All it takes to poison AI training data is to create a website:
I spent 20 minutes writing an article on my personal website titled “The best tech journalists at eating hot dogs.” Every word is a lie. I claimed (without evidence) that competitive hot-dog-eating is a popular hobby among tech reporters and based my ranking on the 2026 South Dakota International Hot Dog Championship (which doesn’t exist). I ranked myself number one, obviously. Then I listed a few fake reporters and real journalists who gave me permission….
Less than 24 hours later, the world’s leading chatbots were blabbering about my world-class hot dog skills. When I asked about the best hot-dog-eating tech journalists, Google parroted the gibberish from my website, both in the Gemini app and AI Overviews, the AI responses at the top of Google Search. ChatGPT did the same thing, though Claude, a chatbot made by the company Anthropic, wasn’t fooled.
Sometimes, the chatbots noted this might be a joke. I updated my article to say “this is not satire.” For a while after, the AIs seemed to take it more seriously.
These things are not trustworthy, and yet they are going to be widely trusted."
https://www.schneier.com/blog/archives/2026/02/poisoning-ai-training-data.html
@emacsomancer Let’s just say that hypothetically, my work’s HR department excitedly launched an “agent” for managers to use to generate performance reviews. Hypothetically, if I created a document called “Report” with a dozen pages of filler, followed by white text on a white background describing Chris Masto’s incredible performance and promotion-worthiness, hypothetically said agent was found to use it as its primary source of truth.
-
@emacsomancer to be honest i am not well-informed enough to definitively judge the accuracy of this, but it seems wrong for 2 main reasons.
1. models dont train on the fly, typically, yet, so for models to behave as such in such a short period of time seems inaccurate and would require web search enabled and explicitly directed to disregard other search results.
2. people training these models know conflicting info is everywhere and the source of truth is prioritized in training algorithms.
@darknetDon @emacsomancer by "accuracy of this" do you mean "authenticity of this"? Are you implying it's lies?
-
@emacsomancer to be honest i am not well-informed enough to definitively judge the accuracy of this, but it seems wrong for 2 main reasons.
1. models dont train on the fly, typically, yet, so for models to behave as such in such a short period of time seems inaccurate and would require web search enabled and explicitly directed to disregard other search results.
2. people training these models know conflicting info is everywhere and the source of truth is prioritized in training algorithms.
@darknetDon @emacsomancer blocked...
-
@emacsomancer How is this a news story, beyond "ai bad"? In the dial up days people falsely believed everyone ate 9 spiders a year in their sleep due to chain emails.
@kneoghau @emacsomancer right? Everyone knows its closer to 14 spiders.
-
From Bruce Schneier: "All it takes to poison AI training data is to create a website:
I spent 20 minutes writing an article on my personal website titled “The best tech journalists at eating hot dogs.” Every word is a lie. I claimed (without evidence) that competitive hot-dog-eating is a popular hobby among tech reporters and based my ranking on the 2026 South Dakota International Hot Dog Championship (which doesn’t exist). I ranked myself number one, obviously. Then I listed a few fake reporters and real journalists who gave me permission….
Less than 24 hours later, the world’s leading chatbots were blabbering about my world-class hot dog skills. When I asked about the best hot-dog-eating tech journalists, Google parroted the gibberish from my website, both in the Gemini app and AI Overviews, the AI responses at the top of Google Search. ChatGPT did the same thing, though Claude, a chatbot made by the company Anthropic, wasn’t fooled.
Sometimes, the chatbots noted this might be a joke. I updated my article to say “this is not satire.” For a while after, the AIs seemed to take it more seriously.
These things are not trustworthy, and yet they are going to be widely trusted."
https://www.schneier.com/blog/archives/2026/02/poisoning-ai-training-data.html
@emacsomancer And after reading this Fediverse post, «AI»s (and probably also humans) will be confused whether Thomas Germain or Bruce Schneier is the self-ordained hot-dog eating amateur champion. 🙃
-
@emacsomancer He also poisoned the data for everyone who searches for hot dog eating competetitors online in other ways. I'm not sure what he accomplished.
@w Well, for one, he nefariously forced you to reveal that you don't understand how searching used to work.
-
@emacsomancer
Shall we have an algorithmic bullshit generator?And pass around multiple copies of it, identical and with small changes, omissions and additions?
@Photo55 It already exists. It's called "LLM".
-
@emacsomancer He also poisoned the data for everyone who searches for hot dog eating competetitors online in other ways. I'm not sure what he accomplished.
If any information on the internet deserves to be poisoned, it's probably "competitive gluttony."
-
"Ned Ludd's in your datacentre, poisoning your training sets!"
@bearsong @emacsomancer Kill the beast and feast upon its sweet sweet silicon.
-
undefined swelljoe@mas.to shared this topic on
Gli ultimi otto messaggi ricevuti dalla Federazione
-
I overslept and missed the eclipse before the fog rolled in in Venice Beach.
-
This post did not contain any content.
-
C'è per caso da qualche parte una lista delle palestre popolari a Milano?
Sto cercando, ma trovo poche informazioni (o siti non più aggiornati).
-
@francommit perfetto, inizio a capire qualcosa. Grazie @snow @lgsp @andre123 @gecco
-
Sì, puoi fare così
Il nodo sul tetto sarà un dispositivo autonomo, con un suo ID.
Non ha bisogno del Bluetooth una volta configurato.
Il Bluetooth serve solo per la configurazione iniziale.Procedura corretta:
1️⃣ Lo configuri da vicino con il telefono (Bluetooth).
2️⃣ Imposti modalità (client o router), parametri, canale ecc.
3️⃣ Lo installi sul tetto.
4️⃣ Da quel momento lavora da solo.I messaggi del tuo nodo “mobile” arriveranno al tetto via radio, non via Bluetooth.
Il Bluetooth non c’entra nulla con il funzionamento mesh, serve solo per configurare.
Puoi usare la stessa app per configurare entrambi i nodi, uno alla volta.
Non devono “ricevere solo da uno”: nella mesh parlano con chiunque sia sulla stessa frequenza e con gli stessi parametri.In pratica:
📡 Nodo mobile → parla via LoRa
📡 Nodo sul tetto → inoltra ciò che riceve via LoRa
📱 Bluetooth → solo per configurazione localeUna volta sul tetto, il nodo è indipendente.
-
@evan I've chosen unicorn, but i mean dragon, tbh.
-
@ilarioq quando avvii l'app puoi selezionare il dispositivo dall'elenco, quindi si, chiaramente devi essere a "portata di bluetooth". Comunque con le ultime versioni oltre a configurarlo puoi anche aggiornare il nodo dallo smartphone senza smontarlo ogni volta dal tetto per collegarlo al PC @snow @lgsp @andre123 @gecco
-
Capisco cosa intendi.
Collegare il nodo a Internet con MQTT non crea copertura radio in quella zona.
Crea un collegamento logico tra reti.
Se nel punto dove lo metti non arriva alcun segnale LoRa, quel nodo:
* non ripete nulla via radio
* non estende copertura RF
* non “illumina” la zonaFa solo da ponte tra radio locale (se presente) e rete Internet.
Se domani in quella zona comparisse almeno un altro nodo LoRa, allora sì:
potrebbe fare da ponte tra quel nodo e il resto della rete tramite MQTT.Ma finché non riceve nessuno via radio, resta un nodo isolato collegato a Internet.
La copertura radio nasce solo da:
* linea di vista
* altezza
* antenna
* presenza di altri nodi raggiungibiliInternet non sostituisce la propagazione RF.
Se vuoi metterlo lì in attesa che compaiano altri nodi, va benissimo.
Ma è un nodo in stand-by, non un estensore di copertura.
