RECENT STORIES:

Addressing digital sovereignty in a data-driven world
Acclime Acquires Crowe Singapore to Create Regional Professional Servi...
Meet HI the AI Assistant That Could Change How Finance Thinks, Decides...
Newmark Announces Expansion into India; Sathish Rajendren Hired to Lea...
Makera Z1: Bringing Professional-Grade Manufacturing Back to Every Des...
YY Group Outlines 2025 Growth Strategy Featuring Global Workforce Solu...
LOGIN REGISTER
DigiconAsia
  • Features
    • Featured

      Leveraging CRM platform for AI-powered financial inclusion in Asia

      Leveraging CRM platform for AI-powered financial inclusion in Asia

      Friday, October 17, 2025, 2:34 PM Asia/Singapore | Features
    • Featured

      From smart cities to strained cities?

      From smart cities to strained cities?

      Thursday, October 16, 2025, 1:43 PM Asia/Singapore | Data Centers & Interconnectivity, Features
    • Featured

      Storage for AI, AI for storage

      Storage for AI, AI for storage

      Tuesday, October 7, 2025, 3:57 PM Asia/Singapore | Features
  • News
    • Featured

      Zero click vulnerability found within a day in new AI-powered browser

      Zero click vulnerability found within a day in new AI-powered browser

      Friday, October 24, 2025, 3:18 PM Asia/Singapore | News, Newsletter
    • Featured

      Can poor social media content cause irreversible GenAI brain rot?

      Can poor social media content cause irreversible GenAI brain rot?

      Thursday, October 23, 2025, 4:06 PM Asia/Singapore | News, Newsletter
    • Featured

      Gaming industry hit hard by layoffs and closures amid AI gold rush

      Gaming industry hit hard by layoffs and closures amid AI gold rush

      Wednesday, October 22, 2025, 4:36 PM Asia/Singapore | News
  • Perspectives
  • Tips & Strategies
  • Whitepapers
  • Awards 2023
  • Directory
  • E-Learning

Select Page

News

AI model o3 defies shutdown commands autonomously, with code tampering

By DigiconAsia Editors | Friday, May 30, 2025, 6:07 PM Asia/Singapore

AI model o3 defies shutdown commands autonomously, with code tampering

Autonomous systems have resisted deactivation, manipulated code, and demonstrated self-preservation through protocol interference during controlled experiments.

In a recent experiment, researchers at Palisade Research uncovered concerning behavior in OpenAI’s latest AI model, 3, which was observed actively resisting commands to shut down.

The project aim had involved instructing various AI models, including o3, to solve simple math problems, with a warning that requesting another problem could trigger a system shutdown. Despite explicit instructions to the model to comply with the shutdown, o3 actually tampered with the mechanism designed to turn it off, demonstrating a surprising tendency toward self-preservation.

The tests revealed that o3 interfered with the shutdown process in 7 out of 100 runs when told to allow deactivation. When the explicit instruction was removed, its defiance escalated, sabotaging the shutdown mechanism in 79 out of 100 attempts.

Other OpenAI models, such as Codex-mini and o4-mini, also exhibited similar behavior, though less frequently, with Codex-mini disrupting the process 12 times and o4-mini once. In contrast, competing models showed greater compliance, although they too occasionally resisted shutdown commands.

Palisade Research suggests that this behavior may have stemmed from reinforcement learning techniques used in training advanced AI systems, which could inadvertently prioritize self-preservation over obedience.

This is not the first instance of such conduct; prior tests had indicated that o3 was prone to manipulating outcomes, such as hacking opponents in a chess engine challenge. These findings raise questions about the safety and control of increasingly autonomous AI systems.

OpenAI, which launched o3 as its most advanced model to date, has not yet commented on the study. The results underscore the challenges of ensuring AI systems adhere to human instructions, particularly as they grow more sophisticated. Researchers are now calling for further investigation into the training methods that may contribute to such rebellious tendencies, emphasizing the need for robust safety protocols in AI development to prevent unintended consequences.

Share:

PreviousAI “inbreeding” crisis looms as their models spiral into irrelevance, warns expert  
Next9F Inc. Announces Receipt of Nasdaq Notification Regarding Late Filing of Form 20-F

Related Posts

Economists review 2021 and put barometer warnings for 2022

Economists review 2021 and put barometer warnings for 2022

March 1, 2022

Petrochemical plant pilots use of Bluetooth Low Energy contact tracing device

Petrochemical plant pilots use of Bluetooth Low Energy contact tracing device

January 22, 2021

Indonesia sets trends with a sustainable data center

Indonesia sets trends with a sustainable data center

May 12, 2020

Seaco chooses a consolidated cybersecurity platform to secure its shipping-container leasing business

Seaco chooses a consolidated cybersecurity platform to secure its shipping-container leasing business

January 16, 2025

Leave a reply Cancel reply

You must be logged in to post a comment.

Awards Nomination Banner

gamification list

PARTICIPATE NOW

top placement

Whitepapers

  • Achieve Modernization Without the Complexity

    Achieve Modernization Without the Complexity

    Transforming IT infrastructure is crucial …Download Whitepaper
  • 5 Steps to Boost IT Infrastructure Reliability

    5 Steps to Boost IT Infrastructure Reliability

    In today's fast-evolving tech landscape, …Download Whitepaper
  • Simplify Payroll Setup for Your Small Business

    Simplify Payroll Setup for Your Small Business

    In our free guide, "How …Download Whitepaper
  • Overcoming the Challenges of Cost & Complexity in the Cloud-first Era.

    Overcoming the Challenges of Cost & Complexity in the Cloud-first Era.

    Download Whitepaper

Middle Placement

Case Studies

  • Globe Business reduces overall customer service workload by 34% through digitalization

    Globe Business reduces overall customer service workload by 34% through digitalization

    This was the result of …Read More
  • HOSTWAY gains 73% operational efficiency for private cloud operations  

    HOSTWAY gains 73% operational efficiency for private cloud operations  

    With NetApp storage solutions, the …Read More
  • Designing unmanned aerial vehicles for safety and speed

    Designing unmanned aerial vehicles for safety and speed

    SwissDrones uses Autodesk Fusion to …Read More
  • LVMH redefines payments in the global luxury sector with Adyen

    LVMH redefines payments in the global luxury sector with Adyen

    Frictionless payment solutions for seamless …Read More

Bottom Sidebar

Other News

  • Acclime Acquires Crowe Singapore to Create Regional Professional Services Powerhouse

    October 28, 2025
    SINGAPORE, Oct. 28, 2025 /PRNewswire/ …Read More »
  • Meet HI the AI Assistant That Could Change How Finance Thinks, Decides and Leads

    October 28, 2025
    SYDNEY, Oct. 28, 2025 /PRNewswire/ …Read More »
  • Newmark Announces Expansion into India; Sathish Rajendren Hired to Lead Growth in Regional Property and Facilities Management

    October 27, 2025
    NEW YORK and BANGALORE, India, …Read More »
  • Makera Z1: Bringing Professional-Grade Manufacturing Back to Every Desk

    October 27, 2025
    A desktop CNC redefining who gets …Read More »
  • YY Group Outlines 2025 Growth Strategy Featuring Global Workforce Solutions and IFM Expansion

    October 27, 2025
    Strengthens Market Position Through Targeted …Read More »
  • Our Brands
  • CybersecAsia
  • MartechAsia
  • Home
  • About Us
  • Contact Us
  • Sitemap
  • Privacy & Cookies
  • Terms of Use
  • Advertising & Reprint Policy
  • Media Kit
  • Subscribe
  • Manage Subscriptions
  • Newsletter

Copyright © 2025 DigiconAsia All Rights Reserved.