Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
Uncategorized
205
Posts
102
Posters
1
Views
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
-
undefined evan@cosocial.ca shared this topic on
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
@firefoxwebdevs the translation model should replace all the words on the page with this badge
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
@firefoxwebdevs@mastodon.social I believe it'd be better if Firefox stopped referring to unwanted slop like chatbots with meaningless marketing terms such as 'AI' instead
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
@firefoxwebdevs I don't care. Local translation in FF is on the level of free early 2000s web translators. So maybe just remove it and add it again, when it's production ready
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
@firefoxwebdevs if I better understood what "downloaded-on-demand ML models" means in practice, I'd feel more qualified to participate. 😉 No external service involved in any way, right? How resource hungry was/is training that model?
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
It's "no" for me, until local LLM is an open and shared model.
Other 3rd parties and commercial apis should be opted out by default and option for permanently hide sloppy chat must never disappear. Until commercial LLM support will be removed. Please. -
@firefoxwebdevs if I better understood what "downloaded-on-demand ML models" means in practice, I'd feel more qualified to participate. 😉 No external service involved in any way, right? How resource hungry was/is training that model?
@xela no external service is used. I'm not sure on the resources used for training, but it's useful to know that would factor into your decision. The project is here https://github.com/mozilla/translations
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
@firefoxwebdevs show any actual evidence that the kill switch is being implemented, then we can talk
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
@firefoxwebdevs see no reason disable it by default. But i am not kind of person «AI kill switch» made for
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
@firefoxwebdevs also, I just gotta ask: was the prompt for this quiz “hey ChatGPT come up with an ai use case that’ll stump the haters! do not hallucinate do not use emojis” or did this ooze out of your human brain after the LLM psychosis fried it?
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
@firefoxwebdevs Because the term "AI" has been so heavily overloaded to include ML, LLMs, Uncle Tom Cobly and all, including the translations in the "AI" kill switch would be signalling to users that their consent is being taken seriously - especially the way that unwanted "AI" is being included so conspicuously in so many tech products at the moment. Ask for consent, don't end up begging for forgiveness on what you see as a technicality.
-
@firefoxwebdevs also, I just gotta ask: was the prompt for this quiz “hey ChatGPT come up with an ai use case that’ll stump the haters! do not hallucinate do not use emojis” or did this ooze out of your human brain after the LLM psychosis fried it?
@zzt I posted this poll after a meeting where we discussed the design of the kill switch, and there was uncertainty around translations. I want to make sure the community's voice is represented in these discussions.
-
@firefoxwebdevs Because the term "AI" has been so heavily overloaded to include ML, LLMs, Uncle Tom Cobly and all, including the translations in the "AI" kill switch would be signalling to users that their consent is being taken seriously - especially the way that unwanted "AI" is being included so conspicuously in so many tech products at the moment. Ask for consent, don't end up begging for forgiveness on what you see as a technicality.
@decadecity I like this framing of it. Thank you!
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
@firefoxwebdevs I'm still on the last good version of FF, 77.0.1, so idk.
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
@firefoxwebdevs besides having on device translation, would it be suitable to also provide on device tool calling models? They get small - see functiongemma.
Could be nice additon for web devs.
But web devs might want to choose fine tuned versions though. -
@firefoxwebdevs if I better understood what "downloaded-on-demand ML models" means in practice, I'd feel more qualified to participate. 😉 No external service involved in any way, right? How resource hungry was/is training that model?
@xela @firefoxwebdevs Translations involve either 1 or 2 models depending on the language pairs. Each language requires a model going into, and out of English. Training a language involves on the order of hundreds of GPU hours, and the largest models probably get into the thousands range. Early models were in the thousands range probably before we optimized things.
-
@firefoxwebdevs besides having on device translation, would it be suitable to also provide on device tool calling models? They get small - see functiongemma.
Could be nice additon for web devs.
But web devs might want to choose fine tuned versions though.@firefoxwebdevs why?
If users use interfaces rarely, they might not remember all kind of interfaces. A text/voice input could be translated into commands. -
@xela @firefoxwebdevs Translations involve either 1 or 2 models depending on the language pairs. Each language requires a model going into, and out of English. Training a language involves on the order of hundreds of GPU hours, and the largest models probably get into the thousands range. Early models were in the thousands range probably before we optimized things.
@xela @firefoxwebdevs For on-device, the power usage is on the end-user, and the text in the viewport range is translated. It's heavy CPU work that is quickly finished. So you get short bursts of heavy CPU usage while actively interacting with a translated page. All the page content is private and stays on your machine.
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
@firefoxwebdevs nice try, but AI functions by breaking consent, & removing ML translations when shutting off AI won't get people to accept AI. Nobody who respects consent wants it, nor will ever want it.
Why don't you skip ahead & have your "AI kill switch" simply uninstall Firefox while you're at it.
We all know that's the inevitable conclusion.
-
Firefox uses on-device downloaded-on-demand ML models for privacy-preserving translation.
They're not LLMs. They're trained on open data.
Should translation be disabled if the AI 'kill switch' is active?
@firefoxwebdevs
Thank you for asking
Gli ultimi otto messaggi ricevuti dalla Federazione
-
@evan a simple but effective way to avoid pile-ons is to not display the number of likes/dislikes. Whether I like something or not shouldn’t depend on others views so showing that stat seems unnecessary.
Of course, that’s predicated on the assumption that using the like button actually means I like it. I use it for a variety of reasons ranging from “I agree” to “I saw this response but have nothing to add.”
-
@stefano
I think there are FUDs.
"No updates" could cause them (especially security officers) fear whether or not there are vulnerabilities, even if there are actually none by design and "the size of codes".
Maybe announcements "We've reviewed our code finding CVExxx for product A by (3rd party name), resulting no same vulnerabilities exists in our codes. You don't need to worry about updates here." could help? "Updates" are not limited with codes.
-
Androidiani.net: un nuovo inizio per una community che non vuole fermarsi
Era impossibile restare indifferenti leggendo l’ultimo saluto di Androidiani.com. Quel messaggio ha segnato la fine di un’era, ma anche l’inizio di qualcosa di nuovo: la consapevolezza che una community come quella degli #Androidiani non può davvero “chiudere”.
https://androidiani.net/androidiani-net-un-nuovo-inizio-per-una-community-che-non-vuole-fermarsi/
-
@vonblubba lascio questo link qui nel caso tornasse utile: http://lucida.to/
-
RE: https://flipboard.com/@ilpost/news-6pgniha4z/-/a-iqlq-yblTlikB7ZwKt-yrg%3Aa%3A2183656918-%2F0
A poca distanza da dove venne assassinato #GeorgeFloyd. Vediamo se gli statunitensi sono ancora in grado di reagire
-
Dopo la pausa natalizia riparto anche con le mie interviste agli sviluppatori italiani.
Stasera ho sentito due dei creatori di Half Away, un videogioco ispirato al folklore slavo e a quello giapponese.
Tra l'altro ho giocato il loro Half Away durante le vacanze.
In realtà l'ho iniziato ma non concluso perché poi mi sono messo a giocare a un sacco di altre cose.
Che ne penso di Half Away?
Se ne parla qui nel video: https://www.youtube.com/watch?v=lHE4Vc5tpls
-
@Otttoz W la Dea!!
-
Current* conditions near Thousand Islands, ON:
