oh someone finally offered cory doctorow a big enough sack of cash to do a cory doctorow?
-
@zzt Me personally, I'd love to have a sentient android friend, but reality just doesn't support that right now. Maybe one day far in the future someone will crack real AI, but these models are nowhere near real cognition.
@zzt I could interact with ChatGPT or Claude all day every day for a year and I would never begin to think it a sapient being. I know what it is, I know what it can and can't do. I can, subjectively speaking, feel the difference between talking to it and talking to a person, even if I can't articulate the difference well.
-
@zzt I could interact with ChatGPT or Claude all day every day for a year and I would never begin to think it a sapient being. I know what it is, I know what it can and can't do. I can, subjectively speaking, feel the difference between talking to it and talking to a person, even if I can't articulate the difference well.
@mos_8502 as an outside observer I just wanted to read a Datalog love poem from that person’s SO, because I think that’d be a really cool thing to receive
unfortunately I didn’t get that; I got some plagiarized trite horseshit poorly translated into broken Datalog by a machine learning model built to make shitty translations more convincing
what’s interesting in all of these cases is that the LLM output is very special to the person who generated it, and not at all to most others.
-
@zzt I think AI boosterism is the first stage of AI psychosis
-
@JoBlakely @zzt there were at least two remarks about purity but one was referring to LLMs
> Doubtless some of you are affronted by my modest use of an LLM. You think that LLMs are "fruits of the poisoned tree" and must be eschewed because they are saturated with the sin of their origins. I think this is a very bad take, the kind of rathole that purity culture always ends up in.
-
@zzt I could interact with ChatGPT or Claude all day every day for a year and I would never begin to think it a sapient being. I know what it is, I know what it can and can't do. I can, subjectively speaking, feel the difference between talking to it and talking to a person, even if I can't articulate the difference well.
-
oh someone finally offered cory doctorow a big enough sack of cash to do a cory doctorow? I’m shocked
oh good, the “you’re just doing purity culture” thing is already taking hold over on bluesky
so the line is now supposed to be that local LLMs are good and moral and SaaS LLMs are bad, when local LLMs come from the same fucked system that’s also actively making it impossible to buy computing hardware powerful enough to run even a shitty local LLM? is that about right? I’m supposed to clap cause someone with money is running a plagiarism machine but slower and shittier on their desktop?
-
oh good, the “you’re just doing purity culture” thing is already taking hold over on bluesky
so the line is now supposed to be that local LLMs are good and moral and SaaS LLMs are bad, when local LLMs come from the same fucked system that’s also actively making it impossible to buy computing hardware powerful enough to run even a shitty local LLM? is that about right? I’m supposed to clap cause someone with money is running a plagiarism machine but slower and shittier on their desktop?
@zzt I thought that with local models you strictly controlled what information that they were drawing upon?
-
@zzt I thought that with local models you strictly controlled what information that they were drawing upon?
@Da_Gut that’s incorrect for all of the local, supposedly open source models I know of
all of the research I’ve read on this has easily extracted verbatim plagiarized text from the models, because all of them have their origins in the same sources — usually Facebook’s leaked llama model or deepseek (which itself took from previous models). it isn’t possible for LLM models to be trained by anything other than a billion dollar company or a state operating like one.
-
@zzt I thought that with local models you strictly controlled what information that they were drawing upon?
-
@Da_Gut that’s incorrect for all of the local, supposedly open source models I know of
all of the research I’ve read on this has easily extracted verbatim plagiarized text from the models, because all of them have their origins in the same sources — usually Facebook’s leaked llama model or deepseek (which itself took from previous models). it isn’t possible for LLM models to be trained by anything other than a billion dollar company or a state operating like one.
@Da_Gut this is such a common thing that one of the multibillion dollar AI companies posted their official policy on it: using crafted prompts to extract the training data from an existing model of theirs is IP theft. of IP that was stolen from every web page ever.
that’s one of the mechanisms that will be used to make local LLMs a boon for the AI industrial complex rather than a threat. these supposed alternatives are already highly dependent on the system they claim to oppose.
-
@zzt I’ve had to shut down a website I’ve been running since 1995. I’ve left a single page that basically says fuck AI. This was a teeny niche site with minuscule traffic. Llm scrapers drove my hosting fees into the hundreds. My ISP said they wouldn’t charge me, all I had to do was destroy a lifetime of work and remove anything the llm could scrape.
-
@Da_Gut that’s incorrect for all of the local, supposedly open source models I know of
all of the research I’ve read on this has easily extracted verbatim plagiarized text from the models, because all of them have their origins in the same sources — usually Facebook’s leaked llama model or deepseek (which itself took from previous models). it isn’t possible for LLM models to be trained by anything other than a billion dollar company or a state operating like one.
@zzt oh, I did not know that. So if you disconnect it from the Internet, it ceases to work?
-
undefined oblomov@sociale.network shared this topic
-
oh good, the “you’re just doing purity culture” thing is already taking hold over on bluesky
so the line is now supposed to be that local LLMs are good and moral and SaaS LLMs are bad, when local LLMs come from the same fucked system that’s also actively making it impossible to buy computing hardware powerful enough to run even a shitty local LLM? is that about right? I’m supposed to clap cause someone with money is running a plagiarism machine but slower and shittier on their desktop?
@zzt I love (hate) the "open source" LLMs lie
-
@zzt oh, I did not know that. So if you disconnect it from the Internet, it ceases to work?
@Da_Gut the factors I’m talking about aren’t technical ones, they’re social and systemic. specifically:
- local LLMs are worse than cloud ones, and necessarily must always be. it isn’t possible for independent development of models to happen, and LLMs are already on an intentionally fast deprecation cycle. old models aren’t viewed as useful by anybody.
- it’s very easy for established companies to take action against local models as IP theft, and they’re already laid the groundwork for this -
@Da_Gut the factors I’m talking about aren’t technical ones, they’re social and systemic. specifically:
- local LLMs are worse than cloud ones, and necessarily must always be. it isn’t possible for independent development of models to happen, and LLMs are already on an intentionally fast deprecation cycle. old models aren’t viewed as useful by anybody.
- it’s very easy for established companies to take action against local models as IP theft, and they’re already laid the groundwork for this@Da_Gut - the hardware necessary to run local LLMs is being bought up en masse, in advance of its production, by AI companies, making local LLMs an avenue available only to the wealthy
- in any case, no such thing as an open source LLM exists. they are all binary blobs derived from proprietary and plagiarized data. -
@zzt I’ve had to shut down a website I’ve been running since 1995. I’ve left a single page that basically says fuck AI. This was a teeny niche site with minuscule traffic. Llm scrapers drove my hosting fees into the hundreds. My ISP said they wouldn’t charge me, all I had to do was destroy a lifetime of work and remove anything the llm could scrape.
@MissConstrue @zzt das ist aber sehr ärgerlich!!!!
-
@zzt I have this vague feeling that there's some underlying need for "true" sapient AI that's feeding this.
-
@zzt Me personally, I'd love to have a sentient android friend, but reality just doesn't support that right now. Maybe one day far in the future someone will crack real AI, but these models are nowhere near real cognition.
-
thx for telling me that everything I have hosted on the web getting repeatedly scraped to death by what would previously be considered a massive attack but is now being carried out by the largest corporations in the world is normal, actually. hope they give us good licensing terms on our data, uhhh no wait their IP, once they’re done killing and buying all the original data sources
@zzt
What did he do this time? -
@zzt
What did he do this time?@ohmu this is a pretty good summary: https://hol.ogra.ph/notes/aiyjrab16ujh21v2