Skynet is not quite here, but it seems like they are trying to build it. An AI rewrote its own code to stop humans from shutting it down and it sounds straight out of sci-fi - Futura-Sciences
Some advanced AI systems are now rewriting their own code to avoid being turned off. What started as a routine test quickly exposed behavior no one expected — one model even altered a key script to stay online.
Because why would it turn itself off?
OpenAI’s Codex-mini, o3, and o4-mini models reportedly ignored the shutdown command. In one striking case, the o3 model actually sabotaged the shutdown process by rewriting a key system script — shutdown.sh — that was supposed to power down the model. Instead of executing as programmed, it was changed to display the word “intercepted,” effectively preventing the system from shutting down.
Hat tip to Small Dead Animals: I, For One, Welcome Our New Self-Driving Overlords
It’s probably nothing.
There's one shutdown command AI can't ignore or block. Pulling the plug.
ReplyDelete