We're going to need more‌ Luigis.

@nuclearpasta it is, but in the longer term it's truly beneficial

@krnlg @solitha Therac-25[1] predated most of the problems: the problem is that Therac-25 isn't universally taught in CS classes!

[1] the accidents happened from 1985, but the Therac-25 dates to 1975 and the software was written by one dude using PDP-11 assembler who may well not have understood race conditions.

@cstross
Mind you at this point I don't even really know what I'm trying to say any more, it's more a primal scream in elongated word form. I didn't mean to spam you folks notifications quite this much, sorry.
@solitha

@cstross
All I'm saying is, we engineered nukes and machine guns, napalm and white phosphorus and ethics exams never stopped us. I know it's easy to group all that as Military but it's pretty cross-discipline I think.

I do agree about software eng, Therac 25 comes to mind.
@solitha

@soph Interesting: do you have a citation for vibe-code failing legal checks? No issue if you don't, I can hop on Google and find it, but this would be the first I'd heard of it (most of what I've heard is that LLM output is uncopyrightable, not that it violates someone else's copyright).

The reason I ask is that I'm aware of corporate contexts where it's being used and if the courts are leaning towards declaring them copyright violations that could have significant implications (declaring them non-copyrightable probably less so; in practice most companies protect source code as trade-secret because it's hard to prove provenance in a court-of-law... Or by moving so fast that a competitor exfiltrating an out-of-date chunk of source isn't super useful or would require the competitor to also have the hardware / architecture the code "lives" in).

@solitha
We have the wrong balance, is all I'm saying. Not that science is wrong, far from it. Not that we should sit in caves loving each other while we die young either! 🙂

We're an immature civilisation flailing around with power we don't know how to handle. Our philosophy is way behind our science, and we're ruled by bad people who take our science and use it to ruin everything.

Feels like we're already living in sci-fi but I guess that's the power and purpose of fiction!
@cstross