@stefano@me Ouch, this is a 3B parameter model likely quantized to 2bit. Gosh, I should have figured that first. That’s the problem with local LLM, the tradeoff is the limited scope of knowledge . Well looks like this particular one was trained over BSD material, mostly, and not Italian cookbooks. Gotta check the configuration. Let’s try another open weights model instead….
Maybe, if we actually want to have better-informed citizens, we should make a better news interface. The full story should be included in social networking posts (including images). Interactivity should be integrated with the reading experience -- not fully separate.
Many social network users make the conclusion that it is a bad idea to try to read the whole article (paywall, not interactive, abusive ads, lose your place in the social network interface) and just respond to the headline, clickbait image, and 10 words of the lede instead. Given the UX provided, this is a very rational step.
Finally, comments are either closed or anonymous -- it's hard to interact with the story, the author, or other readers on the publisher's web site. So, you have to find your way back to the social networking post and give your likes, comments, or shares there. Hopefully you can just back-button away, but sometimes not.
Maybe, if we actually want to have better-informed citizens, we should make a better news interface. The full story should be included in social networking posts (including images). Interactivity should be integrated with the reading experience -- not fully separate.