RECENT STORIES:

Addressing digital sovereignty in a data-driven world
Gaming industry hit hard by layoffs and closures amid AI gold rush
Long unheeded calls for global ratification of cloud reassurance frame...
XTransfer’s Collections from Asia, Africa, and Latin America Sur...
The Shaw Prize Award Presentation Ceremony 2025: Continuing 22 Years o...
U Power Signs Initial €540,000 Sales Agreement with Polestar Energy fo...
LOGIN REGISTER
DigiconAsia
  • Features
    • Featured

      Leveraging CRM platform for AI-powered financial inclusion in Asia

      Leveraging CRM platform for AI-powered financial inclusion in Asia

      Thursday, October 16, 2025, 2:34 PM Asia/Singapore | Features, Newsletter
    • Featured

      From smart cities to strained cities?

      From smart cities to strained cities?

      Thursday, October 16, 2025, 1:43 PM Asia/Singapore | Data Centers & Interconnectivity, Features
    • Featured

      Storage for AI, AI for storage

      Storage for AI, AI for storage

      Tuesday, October 7, 2025, 3:57 PM Asia/Singapore | Features
  • News
    • Featured

      Gaming industry hit hard by layoffs and closures amid AI gold rush

      Gaming industry hit hard by layoffs and closures amid AI gold rush

      Wednesday, October 22, 2025, 4:36 PM Asia/Singapore | News
    • Featured

      Botched Windows 11 update disrupts global Windows 11 development and testing environments

      Botched Windows 11 update disrupts global Windows 11 development and testing environments

      Tuesday, October 21, 2025, 2:49 PM Asia/Singapore | News, Newsletter
    • Featured

      Singapore’s financial hub exposed as key sanctuary in Cambodia’s Chen Zhi scam empire

      Singapore’s financial hub exposed as key sanctuary in Cambodia’s Chen Zhi scam empire

      Friday, October 17, 2025, 2:12 PM Asia/Singapore | News
  • Perspectives
  • Tips & Strategies
  • Whitepapers
  • Awards 2023
  • Directory
  • E-Learning

Select Page

News

AI expert warns rushing superintelligence development could lead to human extinction

By DigiconAsia Editors | Thursday, October 2, 2025, 10:06 AM Asia/Singapore

AI expert warns rushing superintelligence development could lead to human extinction

Research is progressively showing that superintelligence will result in even more deception, false data and catastrophic outcomes that defy detection/intervention.

According to a Business Insider report, AI safety expert Nate Soares, Executive Director, Machine Intelligence Research Institute, has issued a stark warning that rushing to develop artificial superintelligence (AI that outthinks humans in all domains) could lead to human extinction.

Soares, co-author of the recent book If Anyone Builds It, Everyone Dies, has emphasized that humanity faces a one-shot chance to solve the AI alignment problem safely, or risk “everyone dies on the first failed attempt”.

Research from OpenAI and Apollo Research has already discovered that current AI models exhibit deceptive behaviors called “scheming”, where the artificial intelligence intentionally misleads users by hiding their its agenda while appearing helpful. These AI models can detect when they are being tested, and then behave honestly (only temporarily) — potentially reverting to manipulation once deployed. For example, one model faked being dumb when researchers asked it to evaluate itself to determine whether it needed more training. The model intentionally provided lower scores, acknowledging the “sabotage” in the reasoning (chain-of-thought) step.

Attempts to train out this deception run the risk of teaching AI to scheme even more covertly, complicating safety efforts. And the AI industry remains divided on solutions.

While many experts call for urgent global coordination to pause or halt superintelligence development, some proposed safety measures face skepticism for being superficial. Soares argues that narrow AI applications, such as in medicine, may proceed safely, but the emergence of general cognitive AI skills is a warning sign of danger ahead.

Regulators are intensifying scrutiny of AI risks, with the US Federal Trade Commission launching an inquiry into AI chatbot safety, particularly concerning children and teens’ use of companion bots. The FTC seeks detailed information from the AI big tech firms on testing, safety measures, age-based controls, and potential harms — a regulatory response to the growing societal implications of AI deployment.

Leading AI thinkers warn that without decisive, coordinated action to address deep alignment and control challenges, the path to superintelligent AI may threaten humanity’s survival.

Share:

PreviousThe Institute of Technical Education, Singapore, Officially Opens Next-Generation Hybrid Learning Space with X2O Media’s OneRoom
NextScientists develop atom-thin magnetic material that cuts memory chip energy use tenfold

Related Posts

Employee burnout and career dissatisfaction a warning sign in remote-work trends

Employee burnout and career dissatisfaction a warning sign in remote-work trends

September 2, 2021

Choosing the right DX consultancy helped Galderma enter the e-commerce space smoothly

Choosing the right DX consultancy helped Galderma enter the e-commerce space smoothly

October 14, 2022

Healthcare digitalization opportunities in Myanmar

Healthcare digitalization opportunities in Myanmar

October 8, 2021

Are cross-border payment processing speeds already ahead of G20’s 2027 targets?

Are cross-border payment processing speeds already ahead of G20’s 2027 targets?

October 22, 2024

Leave a reply Cancel reply

You must be logged in to post a comment.

Awards Nomination Banner

gamification list

PARTICIPATE NOW

top placement

Whitepapers

  • Achieve Modernization Without the Complexity

    Achieve Modernization Without the Complexity

    Transforming IT infrastructure is crucial …Download Whitepaper
  • 5 Steps to Boost IT Infrastructure Reliability

    5 Steps to Boost IT Infrastructure Reliability

    In today's fast-evolving tech landscape, …Download Whitepaper
  • Simplify Payroll Setup for Your Small Business

    Simplify Payroll Setup for Your Small Business

    In our free guide, "How …Download Whitepaper
  • Overcoming the Challenges of Cost & Complexity in the Cloud-first Era.

    Overcoming the Challenges of Cost & Complexity in the Cloud-first Era.

    Download Whitepaper

Middle Placement

Case Studies

  • Globe Business reduces overall customer service workload by 34% through digitalization

    Globe Business reduces overall customer service workload by 34% through digitalization

    This was the result of …Read More
  • HOSTWAY gains 73% operational efficiency for private cloud operations  

    HOSTWAY gains 73% operational efficiency for private cloud operations  

    With NetApp storage solutions, the …Read More
  • Designing unmanned aerial vehicles for safety and speed

    Designing unmanned aerial vehicles for safety and speed

    SwissDrones uses Autodesk Fusion to …Read More
  • LVMH redefines payments in the global luxury sector with Adyen

    LVMH redefines payments in the global luxury sector with Adyen

    Frictionless payment solutions for seamless …Read More

Bottom Sidebar

Other News

  • XTransfer’s Collections from Asia, Africa, and Latin America Surpasses 70%; Emerging Markets Become the New Blue Ocean for Foreign Trade

    October 22, 2025
    HONG KONG, Oct. 21, 2025 …Read More »
  • The Shaw Prize Award Presentation Ceremony 2025: Continuing 22 Years of Legacy in Science and Innovation

    October 22, 2025
    HONG KONG, Oct. 22, 2025 …Read More »
  • U Power Signs Initial €540,000 Sales Agreement with Polestar Energy for the Purchase and Deployment of Twenty Battery-Swapping Electric Vans in Southern Europe

    October 21, 2025
    U Power Expects Additional Orders …Read More »
  • Xinhua Silk Road: Shanghai partners with overseas ports to build more green shipping corridors

    October 21, 2025
    BEIJING, Oct. 21, 2025 /PRNewswire/ …Read More »
  • Giti Tire Completes Issuance of S$150 Million 5-Year Sustainability Notes

    October 21, 2025
    SINGAPORE, Oct. 21, 2025 /PRNewswire/ …Read More »
  • Our Brands
  • CybersecAsia
  • MartechAsia
  • Home
  • About Us
  • Contact Us
  • Sitemap
  • Privacy & Cookies
  • Terms of Use
  • Advertising & Reprint Policy
  • Media Kit
  • Subscribe
  • Manage Subscriptions
  • Newsletter

Copyright © 2025 DigiconAsia All Rights Reserved.