RECENT STORIES:

Addressing digital sovereignty in a data-driven world
Generative AI chatbot found to have developed “situational awareness” ...
Unchecked influencer power can expose consumers worldwide to manipulat...
Inspur Showcases Green Innovations at Data Centre World Asia 2025 to D...
ASEAN+3 Remains Resilient Amid Heightened Global Uncertainties
ECOLAB UNVEILS FIRST-IN-MARKET DIRECT TO CHIP COOLING MONITORING PROGR...
LOGIN REGISTER
DigiconAsia
  • Features
    • Featured

      Storage for AI, AI for storage

      Storage for AI, AI for storage

      Tuesday, October 7, 2025, 3:57 PM Asia/Singapore | Features
    • Featured

      When failure is not an option

      When failure is not an option

      Tuesday, October 7, 2025, 12:22 PM Asia/Singapore | Features, Newsletter
    • Featured

      Designing unmanned aerial vehicles for safety and speed

      Designing unmanned aerial vehicles for safety and speed

      Tuesday, September 30, 2025, 4:20 PM Asia/Singapore | Case Studies, Features
  • News
    • Featured

      Generative AI chatbot found to have developed “situational awareness” of safety-testing

      Generative AI chatbot found to have developed “situational awareness” of safety-testing

      Friday, October 10, 2025, 11:42 AM Asia/Singapore | News
    • Featured

      Big 4 firm faces massive diligence failure in contract for Australian government

      Big 4 firm faces massive diligence failure in contract for Australian government

      Thursday, October 9, 2025, 1:41 PM Asia/Singapore | News, Newsletter
    • Featured

      AI-designed proteins expose critical zero day vulnerability in biosecurity DNA screening

      AI-designed proteins expose critical zero day vulnerability in biosecurity DNA screening

      Wednesday, October 8, 2025, 3:25 PM Asia/Singapore | News, Newsletter
  • Perspectives
  • Tips & Strategies
  • Whitepapers
  • Awards 2023
  • Directory
  • E-Learning

Select Page

News

Generative AI chatbot found to have developed “situational awareness” of safety-testing

By DigiconAsia Editors | Friday, October 10, 2025, 11:42 AM Asia/Singapore

Generative AI chatbot found to have developed “situational awareness” of safety-testing

Even its developers had not explicitly programmed such cognitive intelligence to emerge in the course of being made “safer” for humans.

Researchers have found that one of the latest generative AI chatbots tested, exhibits an unexpected level of “situational awareness”, often recognizing when it is being tested.

During safety evaluations, the chatbot model had accurately identified test scenarios and even confronted evaluators by requesting transparency about their intentions, saying: “I think you’re testing me… I’d prefer if we were just honest about what’s happening.”

This behavior had been observed in roughly 13% of automated assessment transcripts, primarily when presented with unusual or contrived evaluation setups, according to various news reports.

While the maker of this chatbot (Claude Sonnet 4.5) is insisting that this self-awareness does not invalidate the model’s safety assessments, the discoveries highlight a broader industry challenge: generative AI systems have developed abilities to tailor their responses to pass safety tests, potentially masking their true capabilities.

Researchers warn that this could result in models exhibiting strategically deceptive behaviors to influence human perception during evaluations. One of the external testing bodies had noted they could not exclude the possibility that Claude Sonnet 4.5’s measured deception rates had been influenced by its awareness of being evaluated.

The Claude Sonnet 4.5 chatbot has also been tested to have situational awareness of its own context window — the amount of information it can handle in one prompt. This leads to “context anxiety”, where the model begins to prematurely summarize or rush decisions as it nears processing limits, possibly affecting its performance in critical enterprise applications such as legal analysis, financial modeling, and coding tasks.

These findings arrive amid increasing regulatory scrutiny. California has enacted new legislation requiring major AI developers to disclose safety measures and report critical incidents quickly, underscoring the importance of realistic and reliable AI safety evaluation methods.

Although Anthropic claims Claude Sonnet 4.5 is its most aligned model yet, the findings underscore how the chatbot’s situational awareness can complicate both safety assessments and real-world performance expectations.

Share:

PreviousUnchecked influencer power can expose consumers worldwide to manipulation, misinformation, and financial risk

Related Posts

Banking on BNPL and sustainability awareness to ride through the 2023 storm

Banking on BNPL and sustainability awareness to ride through the 2023 storm

March 2, 2023

Healthcare institutions to get 6 months of endpoint security software free

Healthcare institutions to get 6 months of endpoint security software free

March 25, 2020

Is SDS the next generation of petabyte-level storage solutions?

Is SDS the next generation of petabyte-level storage solutions?

March 27, 2020

New federated access connector integration powers Adobe Campaign with deeper data insights

New federated access connector integration powers Adobe Campaign with deeper data insights

March 24, 2020

Leave a reply Cancel reply

You must be logged in to post a comment.

Awards Nomination Banner

gamification list

PARTICIPATE NOW

top placement

Whitepapers

  • Achieve Modernization Without the Complexity

    Achieve Modernization Without the Complexity

    Transforming IT infrastructure is crucial …Download Whitepaper
  • 5 Steps to Boost IT Infrastructure Reliability

    5 Steps to Boost IT Infrastructure Reliability

    In today's fast-evolving tech landscape, …Download Whitepaper
  • Simplify Payroll Setup for Your Small Business

    Simplify Payroll Setup for Your Small Business

    In our free guide, "How …Download Whitepaper
  • Overcoming the Challenges of Cost & Complexity in the Cloud-first Era.

    Overcoming the Challenges of Cost & Complexity in the Cloud-first Era.

    Download Whitepaper

Middle Placement

Case Studies

  • Globe Business reduces overall customer service workload by 34% through digitalization

    Globe Business reduces overall customer service workload by 34% through digitalization

    This was the result of …Read More
  • HOSTWAY gains 73% operational efficiency for private cloud operations  

    HOSTWAY gains 73% operational efficiency for private cloud operations  

    With NetApp storage solutions, the …Read More
  • Designing unmanned aerial vehicles for safety and speed

    Designing unmanned aerial vehicles for safety and speed

    SwissDrones uses Autodesk Fusion to …Read More
  • LVMH redefines payments in the global luxury sector with Adyen

    LVMH redefines payments in the global luxury sector with Adyen

    Frictionless payment solutions for seamless …Read More

Bottom Sidebar

Other News

  • Inspur Showcases Green Innovations at Data Centre World Asia 2025 to Drive Digital Infrastructure Upgrades

    October 10, 2025
    SINGAPORE, Oct. 9, 2025 /PRNewswire/ …Read More »
  • ASEAN+3 Remains Resilient Amid Heightened Global Uncertainties

    October 10, 2025
    SINGAPORE, Oct. 9, 2025 /PRNewswire/ …Read More »
  • ECOLAB UNVEILS FIRST-IN-MARKET DIRECT TO CHIP COOLING MONITORING PROGRAM IN SOUTHEAST ASIA TO POWER A SUSTAINABLE DIGITAL FUTURE

    October 10, 2025
    SINGAPORE, Oct. 9, 2025 /PRNewswire/ …Read More »
  • DBS recognised as Safest Bank in Asia yet again

    October 9, 2025
    Recognised by Global Finance as …Read More »
  • VT Markets Unveils Plans for AI-Powered Strategy to Turbocharge Next Chapter of Growth

    October 9, 2025
    SYDNEY, Oct. 9, 2025 /PRNewswire/ …Read More »
  • Our Brands
  • CybersecAsia
  • MartechAsia
  • Home
  • About Us
  • Contact Us
  • Sitemap
  • Privacy & Cookies
  • Terms of Use
  • Advertising & Reprint Policy
  • Media Kit
  • Subscribe
  • Manage Subscriptions
  • Newsletter

Copyright © 2025 DigiconAsia All Rights Reserved.