Sounds like we're about to get a lot more Linux users!
-
@malwareminigun @mttaggart My understanding is NPUs are faster and more efficient than GPUs at "ML" tasks (so called "AI.")
As you say though, they're designed for extreme low power. If you scaled a NPU to compete with GPUs I'm pretty sure they'd come out ahead at those specific tasks.
My guess here is, more than anything else, MS just wants to be able to do some stuff locally faster than what can be done via sending to their servers. For example, processing all the screenshots they're taking of people's desktops can be done on the system itself, then they can send all the data to Microsoft to collect after. That data is much smaller than the actual screenshots. (Especially since this could allow doing things like checking for when it actually changes before sending.)
@nazokiyoubinbou Sure, I'm not talking about hypothetical hardware, I'm talking about what's actually shipping. As far as I understood Recall did not use the NPU but what that thing even is has changed a lot
-
@nazokiyoubinbou Sure, I'm not talking about hypothetical hardware, I'm talking about what's actually shipping. As far as I understood Recall did not use the NPU but what that thing even is has changed a lot
@malwareminigun Ok, if we talk about what is typical in most of these devices, then yeah, it's pretty much just to accelerate simple things locally and they probably still intend most of the real processing to be handled on their own servers.
This mostly just makes it a bit cheaper for them to collect their users' private data.
I do think they likely beat out iGPUs though. Plus they're better positioned (eg not going to scorch the system and give away the fact that they're doing all that to users who only look at temps or something.) This also frees up the GPU so it won't be visible in games and stuff if it keeps doing it. The intent is probably to keep them constantly working on collecting and processing data so it's just a background constant people simply accept long term.
-
@malwareminigun Ok, if we talk about what is typical in most of these devices, then yeah, it's pretty much just to accelerate simple things locally and they probably still intend most of the real processing to be handled on their own servers.
This mostly just makes it a bit cheaper for them to collect their users' private data.
I do think they likely beat out iGPUs though. Plus they're better positioned (eg not going to scorch the system and give away the fact that they're doing all that to users who only look at temps or something.) This also frees up the GPU so it won't be visible in games and stuff if it keeps doing it. The intent is probably to keep them constantly working on collecting and processing data so it's just a background constant people simply accept long term.
@nazokiyoubinbou https://chipsandcheese.com/p/intel-meteor-lakes-npu
> Meteor Lake’s iGPU has no problem beating the NPU, as Intel’s slide suggests. My “All GPU” result of 1.38 iterations per second aligns very closely with Intel’s 20 iterations over 14.5 seconds, or 1.379 iterations per second. The iGPU has a noticeable 62% performance advantage over the NPU, even while chugging a full-fat FP32 model. If I level the playing field by handing Intel’s INT8 model to the iGPU, its lead extends to a massive 261%. Finally, a discrete GPU like AMD’s RX 6900 XT is 6.7 times faster even when using FP32.
-
@nazokiyoubinbou https://chipsandcheese.com/p/intel-meteor-lakes-npu
> Meteor Lake’s iGPU has no problem beating the NPU, as Intel’s slide suggests. My “All GPU” result of 1.38 iterations per second aligns very closely with Intel’s 20 iterations over 14.5 seconds, or 1.379 iterations per second. The iGPU has a noticeable 62% performance advantage over the NPU, even while chugging a full-fat FP32 model. If I level the playing field by handing Intel’s INT8 model to the iGPU, its lead extends to a massive 261%. Finally, a discrete GPU like AMD’s RX 6900 XT is 6.7 times faster even when using FP32.
@malwareminigun I thought we weren't comparing discreet GPUs for the obvious reason mentioned above? A 6700XT is not even on the same scale as a NPU... A proper comparison would be like running it on a modern Ryzen chip's built-in GPU.
I'll accept the point on meteor lake, though I'm not sure if they're at the same level even then
Honestly, I suppose it's probably, more than anything else, to free up the GPU so it won't impact gaming or force them to pause the data collection while the GPU is in heavy use. I kind of added edits to that effect, but I'll go all out and say outright that it may be that more than anything else. This way even if you're in a game there is essentially hardware dedicated to doing this stuff in the background that barely impacts anything else in the system.
-
Sounds like we're about to get a lot more Linux users!
@mttaggart hopefully, I'm not gonna run on my hardware, that's for sure
-
@malwareminigun I thought we weren't comparing discreet GPUs for the obvious reason mentioned above? A 6700XT is not even on the same scale as a NPU... A proper comparison would be like running it on a modern Ryzen chip's built-in GPU.
I'll accept the point on meteor lake, though I'm not sure if they're at the same level even then
Honestly, I suppose it's probably, more than anything else, to free up the GPU so it won't impact gaming or force them to pause the data collection while the GPU is in heavy use. I kind of added edits to that effect, but I'll go all out and say outright that it may be that more than anything else. This way even if you're in a game there is essentially hardware dedicated to doing this stuff in the background that barely impacts anything else in the system.
@nazokiyoubinbou I'm citing this for the IGP numbers being substantially higher. That a DGP is another factor of three or more is expected but not the main point here.
-
@nazokiyoubinbou I'm citing this for the IGP numbers being substantially higher. That a DGP is another factor of three or more is expected but not the main point here.
@malwareminigun Alright, well, I'm assuming that this means you agree to the answer to the question then.
-
Sounds like we're about to get a lot more Linux users!
-
@bmoreinis @mttaggart @catsalad Luckily there are more Linux distros out there than Ubuntu that will not so easily roll over to the amerikan bullshit
Ubuntu has not been the best desktop option for a long time so if they want to be complicit then people will go elsewhere
-
undefined oblomov@sociale.network shared this topic
-
Sounds like we're about to get a lot more Linux users!
@mttaggart @BjoernBeck So we are again having Microsoft producing a lot of pc garbage with this version of windows. Oh boy.
-
@bmoreinis jesus fucking christ..not compatible with FOSS
how about they just move to another jurisdiction ? fuck the fascists and their tentacles
this person has no moral compass. should not be a dev. they instantly capitulate to, "how can I do the fascism for them?!"
@bweller @bmoreinis @mttaggart @catsalad
Well, there are other Linux distributions who won't care what California demands.
-
@bweller @bmoreinis @mttaggart @catsalad
Well, there are other Linux distributions who won't care what California demands.
-
@mttaggart it's the year of Linux on the Desktop (for real this time!)
@tess @mttaggart Is there going to be a version of Linux that can run out of the box, with the Linux community providing help and assistance to a myriad of new users who have just installed it and are now stuck?
-
@bweller @bmoreinis @mttaggart @catsalad
Well, there are other Linux distributions who won't care what California demands.
@dazo @bweller @mttaggart @catsalad I know.... but I manage a mutual aid team service that puts Mint on old donated devices and trains and supports users who need them, is all. We use Mint. <sigh>
-
Sounds like we're about to get a lot more Linux users!
Let's be kind to them, everyone. We were all Linux newbies once!
-
Sounds like we're about to get a lot more Linux users!
@mttaggart
It feels like each section in the article is one argument to not get on board -
Sounds like we're about to get a lot more Linux users!
@mttaggart Great update, from something that nobody wants right now to something that nobody wants to see at a distance in a whole lifetime.
Microslop marketing must had some insight by the armageddon guys. -
Sounds like we're about to get a lot more Linux users!
@mttaggart seriously someone should try to vibe code a Linux distro just to see how much better it would be compared to Windows
-
undefined mora@mastodon.uno shared this topic