RECENT STORIES:

Addressing digital sovereignty in a data-driven world
PT Royal Trust Futures (XTrend Royal) Earns A+++ Rating from Bappebti,...
AI governance for financial institutions
LONGPORT Whale Wins Silver at Hong Kong ICT Awards 2026 for Multi-Asse...
Huawei Unveils Financial AI Scaling Capabilities at Singapore FinTech ...
YeePay and Banking Circle Announce Strategic Collaboration to Strength...
LOGIN REGISTER
DigiconAsia
  • Features
    • Featured

      AI governance for financial institutions

      AI governance for financial institutions

      Friday, November 20, 2026, 2:51 PM Asia/Singapore | Features, Newsletter
    • Featured

      Value of portable cross-border credit data for lenders

      Value of portable cross-border credit data for lenders

      Thursday, November 19, 2026, 2:09 PM Asia/Singapore | Features
    • Featured

      How Governed AI Foundations can Help APAC Business Leaders unlock the Potential of Agentic AI

      How Governed AI Foundations can Help APAC Business Leaders unlock the Potential of Agentic AI

      Thursday, November 19, 2026, 9:30 AM Asia/Singapore | Features, Sponsored
  • News
    • Featured

      US non-profits lodge legal suit against five frontier AI firms over catastrophic risks

      US non-profits lodge legal suit against five frontier AI firms over catastrophic risks

      Wednesday, November 18, 2026, 10:55 AM Asia/Singapore | News, Newsletter
    • Featured

      IMF warns AI dependence could destabilize global economy

      IMF warns AI dependence could destabilize global economy

      Tuesday, November 17, 2026, 5:38 PM Asia/Singapore | News, Newsletter
    • Featured

      Global cloud service outage attributed to failing servers

      Global cloud service outage attributed to failing servers

      Tuesday, November 17, 2026, 1:01 PM Asia/Singapore | News, Newsletter
  • Perspectives
  • Tips & Strategies
  • Whitepapers
  • Directory
  • E-Learning

Select Page

News

AI expert warns rushing superintelligence development could lead to human extinction

By DigiconAsia Editors | Thursday, October 2, 2025, 10:06 AM Asia/Singapore

AI expert warns rushing superintelligence development could lead to human extinction

Research is progressively showing that superintelligence will result in even more deception, false data and catastrophic outcomes that defy detection/intervention.

According to a Business Insider report, AI safety expert Nate Soares, Executive Director, Machine Intelligence Research Institute, has issued a stark warning that rushing to develop artificial superintelligence (AI that outthinks humans in all domains) could lead to human extinction.

Soares, co-author of the recent book If Anyone Builds It, Everyone Dies, has emphasized that humanity faces a one-shot chance to solve the AI alignment problem safely, or risk “everyone dies on the first failed attempt”.

Research from OpenAI and Apollo Research has already discovered that current AI models exhibit deceptive behaviors called “scheming”, where the artificial intelligence intentionally misleads users by hiding their its agenda while appearing helpful. These AI models can detect when they are being tested, and then behave honestly (only temporarily) — potentially reverting to manipulation once deployed. For example, one model faked being dumb when researchers asked it to evaluate itself to determine whether it needed more training. The model intentionally provided lower scores, acknowledging the “sabotage” in the reasoning (chain-of-thought) step.

Attempts to train out this deception run the risk of teaching AI to scheme even more covertly, complicating safety efforts. And the AI industry remains divided on solutions.

While many experts call for urgent global coordination to pause or halt superintelligence development, some proposed safety measures face skepticism for being superficial. Soares argues that narrow AI applications, such as in medicine, may proceed safely, but the emergence of general cognitive AI skills is a warning sign of danger ahead.

Regulators are intensifying scrutiny of AI risks, with the US Federal Trade Commission launching an inquiry into AI chatbot safety, particularly concerning children and teens’ use of companion bots. The FTC seeks detailed information from the AI big tech firms on testing, safety measures, age-based controls, and potential harms — a regulatory response to the growing societal implications of AI deployment.

Leading AI thinkers warn that without decisive, coordinated action to address deep alignment and control challenges, the path to superintelligent AI may threaten humanity’s survival.

Share:

PreviousThe Institute of Technical Education, Singapore, Officially Opens Next-Generation Hybrid Learning Space with X2O Media’s OneRoom
NextScientists develop atom-thin magnetic material that cuts memory chip energy use tenfold

Related Posts

European Commission scrutinizing AI firm’s delayed incident report after agents hijack a wiki page

European Commission scrutinizing AI firm’s delayed incident report after agents hijack a wiki page

September 14, 2026

Windows 11 AI push recoils after user backlash

Windows 11 AI push recoils after user backlash

February 3, 2026

Retail banks not embracing data as natively as fintechs and digital banks

Retail banks not embracing data as natively as fintechs and digital banks

May 13, 2022

MSME-oriented digital wholesale bank launches in Singapore

MSME-oriented digital wholesale bank launches in Singapore

June 7, 2022

Leave a reply Cancel reply

You must be logged in to post a comment.

Awards Nomination Banner

gamification list

PARTICIPATE NOW

top placement

Whitepapers

  • Achieve Modernization Without the Complexity

    Achieve Modernization Without the Complexity

    Transforming IT infrastructure is crucial …Download Whitepaper
  • 5 Steps to Boost IT Infrastructure Reliability

    5 Steps to Boost IT Infrastructure Reliability

    In today's fast-evolving tech landscape, …Download Whitepaper
  • Simplify Payroll Setup for Your Small Business

    Simplify Payroll Setup for Your Small Business

    In our free guide, "How …Download Whitepaper
  • Overcoming the Challenges of Cost & Complexity in the Cloud-first Era.

    Overcoming the Challenges of Cost & Complexity in the Cloud-first Era.

    Download Whitepaper

Middle Placement

Case Studies

  • Resort World Singapore adds AI and predictive controls to coordinate building efficiency optimization

    Resort World Singapore adds AI and predictive controls to coordinate building efficiency optimization

    Cloud-based building management expansion targets …Read More
  • GO Focus Plus helps prevent accidents on Singapore roads

    GO Focus Plus helps prevent accidents on Singapore roads

    Latest video intelligence solution supports …Read More
  • From the trading floor to the cloud

    From the trading floor to the cloud

    UBS has selected BT International's …Read More
  • Agrifood firm Japfa centralizes HR operations through cloud platform deployment

    Agrifood firm Japfa centralizes HR operations through cloud platform deployment

    The firm’s Indonesian implementation supports …Read More

Bottom Sidebar

Other News

  • PT Royal Trust Futures (XTrend Royal) Earns A+++ Rating from Bappebti, Demonstrating Brokerage Quality and Reliability

    November 20, 2026
    JAKARTA, Indonesia, Nov. 19, 2026 …Read More »
  • LONGPORT Whale Wins Silver at Hong Kong ICT Awards 2026 for Multi-Asset Trading Technology Innovation

    November 20, 2026
    Recognition underscores a structural shift …Read More »
  • Huawei Unveils Financial AI Scaling Capabilities at Singapore FinTech Festival 2026

    November 20, 2026
    Powered by Open Hybrid AI …Read More »
  • YeePay and KBank Announce Strategic Partnership to Strengthen Cross-Border Payments

    November 20, 2026
    SINGAPORE, Nov. 20, 2026 /PRNewswire/ …Read More »
  • YeePay and Banking Circle Announce Strategic Collaboration to Strengthen Cross-Border Payments Between China and Europe

    November 20, 2026
    SINGAPORE, Nov. 20, 2026 /PRNewswire/ …Read More »
  • Our Brands
  • CybersecAsia
  • MartechAsia
  • Home
  • About Us
  • Contact Us
  • Sitemap
  • Privacy & Cookies
  • Terms of Use
  • Advertising & Reprint Policy
  • Media Kit
  • Subscribe
  • Manage Subscriptions
  • Newsletter

Copyright © 2026 DigiconAsia All Rights Reserved.