AI models don’t really 'get' the BSDs.
-
@glent @david @stefano It's all marketing. A guy you've never met but who has some charisma opens up his trench coat, shows you this thing he says will make doing things easier, & says the first hit is free. Documentation doesn't promise that, it just tells you how to do the thing the correct way. People don't want the right way, they want the easy way. They don't want to learn, they just want it over with.
They trust the charismatic guy in the trench coat because he tells them myths about the work almost doing itself if they would just try the thing he's offering to them. After the first hit, it's all over. The victim is locked in because "This is the easy way, isn't it? All that stuff sounds so complicated, I'm afraid to even try it without using this. It feels so fast & easy to do it this way even though it makes me feel bad too.", then they get used to it, their standards have been lowered, & they try it with other things, then it's too late.
-
AI models don’t really 'get' the BSDs. As a result, they often provide incomplete, imprecise, or flat-out wrong answers by defaulting to Linux paradigms. When it comes to illumos-based systems, they just completely lose the plot.
This is becoming a serious issue for the BSDs and illumos ecosystems. We are seeing entire websites flooded with AI-generated tutorials and guides that are totally incorrect. Most people don't realize this; they follow the instructions, fail, and then assume that the BSDs doesn't work well or are 'unstable' because they have supposedly changed since the guide was written.
Luckily, some people eventually find my blog, reach out, and finally understand what's actually going on. Others, unfortunately, end up on major social sites or comments, claiming that these systems are broken.
In 2026, one of our greatest challenges will be teaching people how to vet their sources and filter information.
And I see this as a very, very uphill battle.#IT #SysAdmin #FreeBSD #NetBSD #OpenBSD #illumos #News #UnderstandingText #Disinformation
@stefano@mastodon.bsd.cafe The funny thing is a lot of the BSDs have fairly comprehensive manuals available from the official site.
-
@stefano Revisiting this post. While I've largely used #ChatGPT and some #Gemini when researching #Linux and #FreeBSD stuff, I'd say #AI has come a long way. Are they perfect? No. Is it a replacement for man pages and the Handbook? No. Can they provide more info, context, and real world examples when the official #documentation falls short? That's a resounding yes.
It's been a while since I've seen AI give utterly incorrect info relating to FreeBSD. I am far from being the FreeBSD god I want to be and even I recognized the incorrect info at those particular times. But this was also a good 1.5 years ago.
I can't speak for #Illumos as I don't use it.
@peteorrall @stefano same. It’s improved a lot and will continue to do so. I remember getting total rubbish from ChatGPT 4. But these days major models do a pretty good job.
My main use is also gap filling for more esoteric stuff. The great thing is you can verify stuff ;) just like everything you read on the internet.
Of course people will believe whatever Claude says. Just like they believe whatever they see on TV. Or some shady website that has great SEO.
-
@peteorrall @stefano same. It’s improved a lot and will continue to do so. I remember getting total rubbish from ChatGPT 4. But these days major models do a pretty good job.
My main use is also gap filling for more esoteric stuff. The great thing is you can verify stuff ;) just like everything you read on the internet.
Of course people will believe whatever Claude says. Just like they believe whatever they see on TV. Or some shady website that has great SEO.
@peteorrall @stefano it important though that we acknowledge it and help others to see it too. That said I do find it to be a very useful tool.
-
AI models don’t really 'get' the BSDs. As a result, they often provide incomplete, imprecise, or flat-out wrong answers by defaulting to Linux paradigms. When it comes to illumos-based systems, they just completely lose the plot.
This is becoming a serious issue for the BSDs and illumos ecosystems. We are seeing entire websites flooded with AI-generated tutorials and guides that are totally incorrect. Most people don't realize this; they follow the instructions, fail, and then assume that the BSDs doesn't work well or are 'unstable' because they have supposedly changed since the guide was written.
Luckily, some people eventually find my blog, reach out, and finally understand what's actually going on. Others, unfortunately, end up on major social sites or comments, claiming that these systems are broken.
In 2026, one of our greatest challenges will be teaching people how to vet their sources and filter information.
And I see this as a very, very uphill battle.#IT #SysAdmin #FreeBSD #NetBSD #OpenBSD #illumos #News #UnderstandingText #Disinformation
-
AI models don’t really 'get' the BSDs. As a result, they often provide incomplete, imprecise, or flat-out wrong answers by defaulting to Linux paradigms. When it comes to illumos-based systems, they just completely lose the plot.
This is becoming a serious issue for the BSDs and illumos ecosystems. We are seeing entire websites flooded with AI-generated tutorials and guides that are totally incorrect. Most people don't realize this; they follow the instructions, fail, and then assume that the BSDs doesn't work well or are 'unstable' because they have supposedly changed since the guide was written.
Luckily, some people eventually find my blog, reach out, and finally understand what's actually going on. Others, unfortunately, end up on major social sites or comments, claiming that these systems are broken.
In 2026, one of our greatest challenges will be teaching people how to vet their sources and filter information.
And I see this as a very, very uphill battle.#IT #SysAdmin #FreeBSD #NetBSD #OpenBSD #illumos #News #UnderstandingText #Disinformation
@stefano oh my 😞. Could you share some examples?
-
@stefano oh my 😞. Could you share some examples?
@zstg in general, linuxisms everywhere. But this is slowly changing.
-
@stefano Revisiting this post. While I've largely used #ChatGPT and some #Gemini when researching #Linux and #FreeBSD stuff, I'd say #AI has come a long way. Are they perfect? No. Is it a replacement for man pages and the Handbook? No. Can they provide more info, context, and real world examples when the official #documentation falls short? That's a resounding yes.
It's been a while since I've seen AI give utterly incorrect info relating to FreeBSD. I am far from being the FreeBSD god I want to be and even I recognized the incorrect info at those particular times. But this was also a good 1.5 years ago.
I can't speak for #Illumos as I don't use it.
@peteorrall @stefano As you tagged #illumos: in my experience Claude does a fantastic job of fixing hard problems using native illumos tooling. It knows how to talk DTrace, mdb, ptools, etc. I can give it a /goal and it will generally go away and do it with little prompting. Usually the main area I have to help it along with is analyzing flamegraphs.
That said it is disheartening to see them drop illumos/*BSD/etc support, so hopefully others will step up here so we can continue agentic probes.
-
@stefano Or maybe the info about BSDs is so complex, fragmented, and outdated that it cannot be automatically processed?
-
@stefano Or maybe the info about BSDs is so complex, fragmented, and outdated that it cannot be automatically processed?
@nk outdated fragmented and complex? BSD documentation? Quite the opposite.
Ciao! Sembra che tu sia interessato a questa conversazione, ma non hai ancora un account.
Stanco di dover scorrere gli stessi post a ogni visita? Quando registri un account, tornerai sempre esattamente dove eri rimasto e potrai scegliere di essere avvisato delle nuove risposte (tramite email o notifica push). Potrai anche salvare segnalibri e votare i post per mostrare il tuo apprezzamento agli altri membri della comunità.
Con il tuo contributo, questo post potrebbe essere ancora migliore 💗
Registrati Accedi