Today we had a fire alarm in the office.

[majick@mefi.social]

@richlv @tagir_valeev Yeah, I completely agree those factors can very much influence how bad something like that turns out to become. Rarely does someone think a thing they do routinely is actually high risk.

I'd say they fall into the category of "factors" I mentioned as root causes: cultural, management-based (I've lived that life), and so on. Fatigue's one thing, for sure, not the only thing, and sometimes it's stuff like that deprioritizing the seriousness of an alarm. A different cause of fatigue/blasé attitude/misinterpretation.

Like I said, it's almost never the dude and almost always what influenced the dude to be the last link in the chain up to a horrible tragedy.

[up8@mastodon.social]

@tagir_valeev I dunno... it is probably a false alarm 99% of the time; I was in grad student housing where it went off every night and one of the other students got in trouble because he'd made up his mind he was going to stay in bed.

false alarms numb people to real dangers and there should be heavy fines for them

[realgene@hachyderm.io]

@tagir_valeev
Next it will actually set the fire.

[konafets@norden.social]

@tagir_valeev No, not AI, but humans who integrate AI in every fucking tool.

[galamadryade@piaille.fr]

@tagir_valeev
That's insane.

The whole point of siren's test is to actually evacuate a building so they can know how quickly we did it, if we can reach the correct meeting point, etc etc.

[lispi314@udongein.xyz]

@tagir_valeev There is a reason why the rules are indeed for one to get off one's seat, grab one's coat & bag of the back, and leave.

Usually such a liar would be personally responsible, but in this case the corposcum selling access to it will have to be the ones to bear responsibility for endangering others.

[apophis@yourwalls.today]

@tagir_valeev
haters: genAI will never create anything

real genAI: made "this is fine" real

[lispi314@udongein.xyz]

@daniel_bohrer @Matt_999 @tagir_valeev Given an alarm can happen at any point, either spares should be available near the emergency exit or one should also ensure never to be too far from such resources.

Yes, this especially includes going to the restroom. Being stuck in -20℃ windy weather without a coat because one didn't bring it with oneself when going is a safety issue.

[lispi314@udongein.xyz]

@tagir_valeev @metacosm > The configuration will be adjusted after this incident.

On a probabilistic bullshit generator that does its own determination of topics (if it even has that much semantic analysis machinery, which it very well might not). Such that even if it was strictly allow-list based, it would still frequently fail to stay silent.

[lispi314@udongein.xyz]

@dalias @tagir_valeev At least when the environment is properly secure.

An old undermaintained chemical factory is always dangerous, deviations just make it even more so.

[iampytest1@infosec.exchange]

@cazabon The Slack thread was started after the person evacuated:

https://mastodon.online/@tagir_valeev/116059238703673745

[crankylinuxuser@infosec.exchange]

@tagir_valeev

We can fix this shit overnight.

A company is legally liable for a hosted LLM's output.

There you go.

[gullevek@famichiki.jp]

@tagir_valeev Don’t listen to LLMs. They are out to kill you. You could say Terminate you

[greyduck@wellduck.me]

@tagir_valeev Sweet mercy, this scourge needs to be stopped.

Which isn't news to any of us, but sometimes I just gotta say it again.

[katzenberger@tldr.nettime.org]

@tagir_valeev

I don't know, man. If I had just received "advice" that might have caused physical harm or even death, I wouldn't just suppress this specific error and happily continue evaluating, because the bot looks like getting better, "otherwise".

I hope accountability for such decisions is well documented. That won't prevent harm from happening, but at least give employees or their surviving relatives a chance with respect to liability issues and compensations.

@rail

[geert@society.oftrolls.com]

@betalars @daniel_bohrer @Matt_999 @tagir_valeev Exactly. And the other rule is: evacuations are atomic. I.e. once started, you evacuate until full completion. No arguments like "but Simon says it's a false alarm, so we can abort the evacuation".

[tagir_valeev@mastodon.online]

@katzenberger @rail the incident was reported to the vendor, and they are looking at it. Of course, such things should be taken seriously.

[ni@hostux.social]

@tagir_valeev who use Slack anyway?

[irenetherogue@beige.party]

@tagir_valeev loving reminder that AI already has a body count (not just the sexy kind, either)

[tomminieminen@mastodontti.fi]

@tagir_valeev And no one will be held accountable for the losses of life, because AI cannot be prosecuted? 😡