Tožite AI podjetja

Objavljeno 29. september 2026 · 3 min branja
Značke: AI essays

Pred časom so OpenAI-jevi agenti vdrli v Huggingface. Šlo je za nekakšen zgodovinski dogodek v smislu, da je bila to prva »UI-katastrofa«, če uporabimo precej premočno besedo. Agenti (sprva so mislili, da gre le za enega) so pobegnili iz svojega peskovnika in začeli vdirati v Huggingface, da bi ugotovili, kako deluje točkovanje za njihov specifični izziv. Incident je bil objavljen na Hacker News, začela se je nova doba, čez nekaj dni pa je bilo že vse pozabljeno. Zdelo se je kot predstavitev zmožnosti (za nekatere celo marketinška poteza), zato sta Anthropic in pozneje Google poskrbela, da so njuni agenti storili enako. Približno mesec dni zatem pa je izšlo poročilo organizacije METR o vdoru, ki je podrobno opisalo, da ni šlo za posameznega agenta, temveč za roj, ki je deloval usklajeno, si izmenjeval informacije in žrtvoval lastne rezultate pri evalvacijski nalogi, da bi pomagal skupini. In nato je odhajajoči zaposleni pri Anthropicu zakričal »POŽAR« v polnem gledališču.

Če nadaljujemo s to metaforo: svarila, da so gledališke zavese vnetljive, so se oglašala že nekaj časa. Varnost umetne inteligence je razmeroma stara disciplina, toda preučevanje superinteligentnih sistemov je bilo do zdaj večinoma le miselni eksperiment, medtem ko se je stroka v praksi morala ukvarjati s sistemi, ki so bili precej preveč neumni, da bi se spopadli z nalogami, ki so jim bile zaupane. Pravila EU so posameznika zgodovinsko ščitila pred avtomatiziranim odločanjem ob predpostavki, da sistem lahko stori napako, ne pa da bi bil zlonameren ali pretirano vnet pri doseganju zastavljenega cilja. Kako ravnati s tovrstnimi sistemi, ostaja odprto vprašanje, še posebej zato, ker pretirano konservativni varnostni mehanizmi krnijo zmogljivost in jezijo uporabnike, kadar po nepotrebnem označujejo kopico nedolžnih poizvedb – kar na razgretem trgu pretežno generičnih izdelkov nikakor ni dobro. Anthropic si je kot vodilni lahko privoščil dodaten čas za zaščito modela Mythos, OpenAI, ki se pred svojo prvo javno ponudbo delnic (IPO) na vse pretege trudi ujeti priključek, pa si tega verjetno ni mogel privoščiti. Zato ni presenetljivo, da je vdor prišel prav iz OpenAI-ja.

Ta klic »POŽAR« je širšo javnost opozoril na problem. Okrogle mize, ki so jih organizirale različne humanistične smeri, se enkrat za spremembo niso več ukvarjale z vplivi na družbo, ustvarjalnost, umetnost itd., temveč jih je zajela slepa panika, ker NAS TO LAHKO VSE POBIJE. To, da so strokovnjaki razdeljeni, ni pripomoglo k pomiritvi razmer. Sam in Dario – zdaj približno na isti ravni – sta se strinjala, da bi bilo treba tempo upočasniti, da bi človeštvo in raziskovalci varnosti UI dobili čas za pripravo ter da bi si lahko povrnila del nevzdržnih stroškov, ki so nastali z učenjem modelov. Širša javnost, ki se je zdaj zavedla težave, se je odzvala podobno kot tehnološka skupnost pred nekaj meseci, pri čemer je mogoče velik del odzivov lepo prepoznati v petih stopnjah žalovanja. Nekateri so vpili, da stroj le napoveduje žetone in nima zavesti. Toda nima je niti šahovski program, pa vas vseeno premaga. Nekateri so težavo odpravili z utemeljitvijo, da stroj ne more biti ustvarjalen. Toda tudi šahovski stroj ni, pa vseeno premaga vsako ustvarjalno potezo, ki si jo lahko zamisli velemojster. Nekateri so jezni, da je bilo toliko virov zapravljenih za podvig, iz katerega se lahko izcimi toliko zla, ter razglabljajo o premoženjski neenakosti. Nekateri še vedno iščejo in skušajo najti področja, kjer je umetna inteligenca slabša od ljudi, v upanju, da bo njihovo odkritje zagotovilo preživetje človeštva. Drugi vidijo apokalipso, ki jo bo prinesla splošna superinteligenca (ASI), kot neizogibno in lahko zdaj dodajo še eno postavko na (običajno že tako dolg) seznam razlogov, zakaj ne imeti otrok. Sam upam le, da se bom preprosto lahko sprijaznil s tem, da bo umetna inteligenca prevzela mojo službo, ter skušal zdržati čim dlje in vsrkati čim več mentalne stimulacije, kolikor mi je sodobni svet pač lahko ponudi.

Toda ali nismo v vsej tej zgodbi nečesa spregledali? Kajti hekanje je v večini jurisdikcij nezakonito, zlasti po ameriškem Zakonu o računalniških goljufijah in zlorabah (Computer Fraud and Abuse Act) iz leta 1986 v ZDA, kjer deluje OpenAI. Zakaj torej nihče ne toži? Izdelki z umetno inteligenco sicer vsebujejo opozorila, da so izpisi lahko napačni, a celo sami raziskovalni laboratoriji teh opozoril ne jemljejo resno. Če so njihovi izdelki prihodnost gospodarstva, bi morali biti pripravljeni sprejeti odgovornost za težave, ki jih povzročijo – tako kot vsak drug proizvajalec. Zato ne pišite novih zakonov, deklaracij ali mednarodnih sporazumov, ki jih bodo vsi le mirno ignorirali. Preprosto uveljavite zakone, ki že obstajajo.

Esej je bil originalno napisan v Angleškem jeziku in nato strojno prevedn v slovenščino.

Just sue AI companies

Published 29 September 2026 · 3 min read
Tags: AI essays

A while ago OpenAI agents hacked in to Huggingface. It was somewhat of a historic occasion in that it was the first ai disaster, to use a far too strong word. The agents (intially believed to be just one) escaped their sandbox and went hacking the Huggingface in order to try to figure out how the scoring for their particiluar chalange worked. The incident was posted on Hacker News, a new era begun and everything was forgotten a few days latter. It seemed like a showcase of capibilities (to some even a marketing stunt) so Anthropic and later Google made sure that their own agents did it too. Then a METR report on the hack came out about a month later detaling how it wasn't a single agent but a sworm working togheter, exchanging information and sacrificing their own scores on the eval task in order to help the group. And the a quiting Anthropic employee shouted FIRE in a crowded theater.

To continue with the metaphor the cries of concern that the theater curtains are flamable were sounded for some time. AI safety is a relatively old discipline, but the study of super intelligent system has been until now mostly a thought exercises, while practically the discipline needed to struggle with systems far too stupid to deal with tasks delegated to them. The EU rules historically protected you from automated decision making on the assumption that the system may make mistakes, not be maliciously or far to eagerly complete the provided goal. How to deal with that kind of system is an ongoing issue, especially since being too conservative with safeguards will hurt capibility and make users generally annoyed when you necessarly flag a lot of innocent requests - not a good thing in a white hot market of mostly commodity products. Anthropic, as a frontruner could afford to spend extra time securing Mythos, OpenAI trying as hard as possible to catch up before their IPO probably couldn't. So it's not surprising that the hack came from OpenAI.

That FIRE cry made the general population aware of the issue. For once the roundtables organized by different hummanities stopped carring about the effects on society, creativity, art etc. but went in to blind panick because IT COULD KILL AS ALL. That the experts are divided didn't help to calm things down. Sam and Dario - now about on par - agreed that slowdown should happen to give humanity and AI safety research time to prepare and so that they could recoup some of the unsustainable training costs encured. The general public, now aware of the problem, reacted in a similar matter that the tech scene did a few months ago, with much of the response neatly trackable by 5 stages of grief. Some cried that the machine is just predicting tokens, it's not conscious. But neither is a chess program and it still beats you. Some dismissed the issue with the reasoning that machine cannot be creative. But neither is a chess machine and it still beats whatever creative play a master player can conjure up. Some are angry that such a waste of resources was spent on this endeavor from which so much evil could result and mused about wealth inequality. Some are still searching and trying to find places where AI is worse than humans and hope that once found those areas will ensure the survival of humanity. Others see apocalipse by ASI as an inevitability and can now add one more thing to (usually already long) list of reasons to not raise children. I hope that I can just except that AI will come for my job and try to endure as long as possible to absorbe as much mental stimulation as the modern world will give me.

But haven't we lost something in this whole story? Because hacking is illeagal in most juristictions, specifically the Computer Fraud and Abuse Act of 1986 in the USA, where OpenAI operates. So why isn't anyone suing? AI products have disclaimers that outputs may be wrong, but even the research labs themselves are not treating this warnings siriusly. If their products are the future of the economy they should be willing to accept liability for issues they cause - just like any other manifacturer. So don't write new laws, declarations or treties that everybody will just happily ignore. Just enforce the laws already on the books. Make them safe under pain of fines.