@glyph Did you quote post something?
Uncategorized
903
Posts
312
Posters
0
Views
-
@glyph Absolutely, but even in that we can make out the general shape of the thing. We know this current model is not economically sustainable by any party. For users, the result will be inability to access models, or paying cripplingly high prices to do so. Option 1 will elucidate their inability to function without the models, and option 2 will impose the kinds of costs that look like rock bottom in other addictions.
@mttaggart @glyph If there is such an unwinding I think users that can't afford premium service providers will fall back to free/subsidized providers and tools that run on-device. A whole spectrum rather than a binary have / have not.
-
My old boss became very reliant on LLMs…even though she could clearly see their limitations in terms of the field we were working in. I’m talking 6 mths ago and I appreciate that improvements to LLms are occurring weekly if not daily. But while she lapped them up (she was dyslexic and used to try and hide it by getting others to do all her written communications) I found LLMs left me frustrated - a lot of time wasted on prompts that led to diminishing returns.
-
@glyph I wonder how long before "never used LLM" is a positive line item on a resume... 😂
-
@glyph if you’re not familiar, searching for “variable intermittent reinforcement” might be informative. It’s the same mechanism behind slot machines, Facebook notifications, and email.
-
@glyph if you’re not familiar, searching for “variable intermittent reinforcement” might be informative. It’s the same mechanism behind slot machines, Facebook notifications, and email.
-
@genehack the phrasing and adjacency to "slot-machine" as an adjective was not an accident :)
-
@glyph so apparently I get to be glad I forgot to ever try kratom despite repeated urging from a friend several years back.
Thanks, ADHD!
-
@glyph if you’re not familiar, searching for “variable intermittent reinforcement” might be informative. It’s the same mechanism behind slot machines, Facebook notifications, and email.
-
@genehack the phrasing and adjacency to "slot-machine" as an adjective was not an accident :)
@glyph sure, and I read that post — that area is something where I have personal experience (some time at NIDA, learned a thing or two…) so the parallels resonate stronger for me, and I’m maybe more attuned than usual to the resulting dangers.
Glad you’re aware of all of that, I think it’s an aspect many folks miss.
-
@glyph sure, and I read that post — that area is something where I have personal experience (some time at NIDA, learned a thing or two…) so the parallels resonate stronger for me, and I’m maybe more attuned than usual to the resulting dangers.
Glad you’re aware of all of that, I think it’s an aspect many folks miss.
@genehack Gotcha. By the way, if there's a subtle distinction in between "variable intermittent reinforcement" and "intermittent reward schedule" as terms of art I'd definitely be curious to hear it — to my understanding they are strictly synonyms and used interchangeably.
-
@genehack Gotcha. By the way, if there's a subtle distinction in between "variable intermittent reinforcement" and "intermittent reward schedule" as terms of art I'd definitely be curious to hear it — to my understanding they are strictly synonyms and used interchangeably.
@glyph as far as I know — as an adjacent non-expert person — they’re synonyms.
The way it was explained to me involved a rat in a cage with a food pellet lever. If pushing the lever resulted in a food pellet every time, rat pushed the lever when it was hungry. If pushing equaled no pellet, rat pushed it a few time then lost interest and stopped forever. If the lever push was 50-50 (or even worse odds) food pellet vs nothing, rat would sit there all day and push the lever over and over.
-
@glyph I mean, I don't know what to tell you. Are you still really doubting that these things are useful? I've written so many times about this now, are you dismissing it? I can point you to code that I've written over the last seven days that in terms of complexity and utility, is way beyond what we've been able to push out over Christmas. (eg: https://github.com/mitsuhiko/tankgame which is public)
Like, how can you doubt this? It just boggles my mind.
@mitsuhiko @glyph A greenfield project seems like a good way to trial new technology but it's not a real world condition. Greenfield eventually turns to brownfield. Time and complexity shows where simple systems begin to break down.
Once that happens the AI tools become exponentially worse at making changes. Limited context windows. Complex logic changing over time. Updated dependencies.
And the human may lack the knowledge or ability to pick up the slack: https://leadershiplighthouse.substack.com/p/i-went-all-in-on-ai-the-mit-study
-
@genehack Gotcha. By the way, if there's a subtle distinction in between "variable intermittent reinforcement" and "intermittent reward schedule" as terms of art I'd definitely be curious to hear it — to my understanding they are strictly synonyms and used interchangeably.
The main difference is that "reinforcement" and "reward" are not the same thing - reinforcement is a process meant to encourage a behavior, but it doesn't have to mean giving a reward. It could for instance involve removing an aversive stimulus - this is called negative reinforcement, one of the most misunderstood terms in psychology. So saying something is "intermittent reward" is more specific than saying it's "intermittent reinforcement".
-
The main difference is that "reinforcement" and "reward" are not the same thing - reinforcement is a process meant to encourage a behavior, but it doesn't have to mean giving a reward. It could for instance involve removing an aversive stimulus - this is called negative reinforcement, one of the most misunderstood terms in psychology. So saying something is "intermittent reward" is more specific than saying it's "intermittent reinforcement".
This graph shows the 4 main kinds of operant conditioning. Reward covers the top left corner only, reinforcement covers the whole top half.
-
The main difference is that "reinforcement" and "reward" are not the same thing - reinforcement is a process meant to encourage a behavior, but it doesn't have to mean giving a reward. It could for instance involve removing an aversive stimulus - this is called negative reinforcement, one of the most misunderstood terms in psychology. So saying something is "intermittent reward" is more specific than saying it's "intermittent reinforcement".
-
-
Oh that's true, "variable" and "intermittent" are not quite the same either. Variable and fixed are both kinds of intermittent schedule.
So there are two distinct subtle differences in those phrases
-
@xgranade to this point I have had kratom users — mostly indirectly, I am not particularly close with any — suggest that I try it because it is "more effective" and "easier to get" than prescription ADHD meds. And I'd definitely be lying if I didn't say I feel a *strong* pull towards believing that. It would be very nice to solve all my problems with a pill or a prompt
@xgranade I should clarify that other ADHD meds are a great thing and I have even had good personal experience with some, and they are in fact way too hard to get. I didn’t mean to dismiss them with the “pill” comment (and it was a poor choice of words given that kratom rarely comes in pill form). the toxic allure of something like kratom is the promise of something easy which is actually a poison, I don’t want to lump that in with the reductive/wrong idea “psychoactive meds are bad”.
-
@xgranade definitely going to make a killing when I put all this low-linear-algebra steel back on the market
Gli ultimi otto messaggi ricevuti dalla Federazione
-
@aeva *exaggerated hair shoulder toss* don't hate me because I'm beautiful!
-
@luca a proposito, che ne pensi di questa idea? https://news.dyne.org/rethinking-r-i-funding-opting-for-continuity/
-
@informapirata @informatica @filippodb
Fortunatamente l'iniziativa è dell'unità CNECT/E3 (che è molto collaborativa), e non CNECT/C3.
Con la C3 abbiamo avuto un'esperienza a dir poco surreale e sicuramente poco incoraggiante per l'open-source:
-
@Sirchrism le consultazioni sono uno strumento frequentemente adottato dall'Unione
-
This sign was a crowd favorite; people kept pointing me to it. The woman holding the sign hold me she was fine with being in the photo.
-
Look what I found
-
@rl_dane I once dropped my work Thinkpad down two flights of concrete stairs. Still worked. They're indestructible. 🔥
