LOGIN REGISTER
DigiconAsia
  • Features
    • Featured

      Overcoming the limitations of connectivity infrastructure in the AI era

      Overcoming the limitations of connectivity infrastructure in the AI era

      Friday, November 13, 2026, 5:06 PM Asia/Singapore | Features, Newsletter
    • Featured

      The evolution from digital commerce to agentic commerce

      The evolution from digital commerce to agentic commerce

      Monday, November 9, 2026, 10:03 AM Asia/Singapore | e-Commerce, Features, Newsletter
    • Featured

      Why enterprise AI breaks down

      Why enterprise AI breaks down

      Thursday, October 29, 2026, 9:44 AM Asia/Singapore | Features, Newsletter
  • News
    • Featured

      Trump proposes former Apple CEO as replacement for Jensen Huang’s vacated roles

      Trump proposes former Apple CEO as replacement for Jensen Huang’s vacated roles

      Friday, November 13, 2026, 12:13 PM Asia/Singapore | News, Newsletter
    • Featured

      Scientists design special molecule that functions as a light-readable qubit

      Scientists design special molecule that functions as a light-readable qubit

      Wednesday, November 11, 2026, 4:19 PM Asia/Singapore | News
    • Featured

      Report projects 243m generative AI users in six South-east Asian markets

      Report projects 243m generative AI users in six South-east Asian markets

      Tuesday, November 10, 2026, 12:22 PM Asia/Singapore | News, Newsletter
  • Perspectives
  • Tips & Strategies
  • Whitepapers
  • Directory
  • E-Learning

Select Page

News

Research shows small desktop AI models can be efficient alternatives to centralized AI

By DigiconAsia Editors | Tuesday, June 23, 2026, 12:05 PM Asia/Singapore

Research shows small desktop AI models can be efficient alternatives to centralized AI

As questions grow around the sustainability of demand for building massive AI infrastructure, desktop AI models are attracting intense interest.

A November 2025 study from Stanford University study is reshaping assumptions about generative AI, by showing that compact models running on domestic compute machines can perform on par with large cloud-based systems across most tasks, while using significantly less power.

The findings, highlighted in Reuters, introduce the idea of “intelligence per watt” and suggest that the economic case for ever-larger AI systems may be less certain than widely believed.

Researchers evaluated more than 20 local language models with up to 20bn active parameters. These models were tested on eight different hardware accelerators using one million real-world, single-turn queries involving chat and reasoning. Results showed local systems handled 88.7% of queries correctly, while surpassing 90% accuracy in creative tasks, and maintaining strong performance in areas such as sales, management, and entertainment.

On complex reasoning tasks performance gaps narrowed further. Smaller models matched large-scale systems in roughly half of these challenging scenarios, a sharp improvement from just 8% two years earlier, according to interpretations of the test data. Over the same period, “intelligence per watt” rose 5.3-fold, driven by a 3.1x improvement in model design and a 1.7x boost from hardware advancements. These efficiency gains translate into meaningful cost reductions.

The researchers found that using a routing system that directs queries to local models when viable, can reduce energy consumption by 80.4%, and computing costs by 73.8%, compared with relying solely on cloud-based inference. Even with a less accurate routing system operating at 80% effectiveness, energy savings can still exceed 60%.

As questions grow around the sustainability of demand for large-scale AI infrastructure, particularly for firms like Nvidia that supply GPUs to data centers, the Stanford research offers possible alternatives using smaller, cheaper models. It also reflects a broader shift in the industry, where newer local models now deliver greater efficiency than older systems running on specialized infrastructure. Even Nvidia itself has acknowledged this direction, stating in a 2026 paper that smaller models are better suited for agentic AI due to their efficiency and cost advantages.

Share:

PreviousThe “Global Business Districts Innovation Club Seoul Trip” Exchange Event Successfully Concludes
NextLuxshare Precision’s Grace Wang Ranks Among Top 10 on Fortune’s 2026 Most Powerful Women in Business List

Related Posts

Zuno General Insurance blazes new trails in reforming driver behavior in India

Zuno General Insurance blazes new trails in reforming driver behavior in India

June 20, 2025

Transformative urban digital twin and city modeling deployments to exceed 500 by 2025

Transformative urban digital twin and city modeling deployments to exceed 500 by 2025

September 18, 2019

AI-driven contact tracing platform now at the disposal of world governments

AI-driven contact tracing platform now at the disposal of world governments

April 30, 2020

AI leaders soften job loss warnings amid policy debates, memo leaks and public backlashes

AI leaders soften job loss warnings amid policy debates, memo leaks and public backlashes

June 2, 2026

Leave a reply Cancel reply

You must be logged in to post a comment.

Awards Nomination Banner

gamification list

PARTICIPATE NOW

top placement

Whitepapers

  • Achieve Modernization Without the Complexity

    Achieve Modernization Without the Complexity

    Transforming IT infrastructure is crucial …Download Whitepaper
  • 5 Steps to Boost IT Infrastructure Reliability

    5 Steps to Boost IT Infrastructure Reliability

    In today's fast-evolving tech landscape, …Download Whitepaper
  • Simplify Payroll Setup for Your Small Business

    Simplify Payroll Setup for Your Small Business

    In our free guide, "How …Download Whitepaper
  • Overcoming the Challenges of Cost & Complexity in the Cloud-first Era.

    Overcoming the Challenges of Cost & Complexity in the Cloud-first Era.

    Download Whitepaper

Middle Placement

Case Studies

  • Resort World Singapore adds AI and predictive controls to coordinate building efficiency optimization

    Resort World Singapore adds AI and predictive controls to coordinate building efficiency optimization

    Cloud-based building management expansion targets …Read More
  • GO Focus Plus helps prevent accidents on Singapore roads

    GO Focus Plus helps prevent accidents on Singapore roads

    Latest video intelligence solution supports …Read More
  • From the trading floor to the cloud

    From the trading floor to the cloud

    UBS has selected BT International's …Read More
  • Agrifood firm Japfa centralizes HR operations through cloud platform deployment

    Agrifood firm Japfa centralizes HR operations through cloud platform deployment

    The firm’s Indonesian implementation supports …Read More

Bottom Sidebar

Other News

  • EuroCham Singapore Marks 25 Years at Anniversary Gala as Leaders Look Ahead to the Next Chapter of EU-Singapore Business Ties

    November 16, 2026
    Over 300 senior European and …Read More »
  • HKEX Launches Offshore RMB Bond Index

    November 16, 2026
    First HKEX branded fixed-income index, …Read More »
  • Master Concept Partners with ElevenLabs to Accelerate Enterprise Voice AI Adoption

    November 16, 2026
    Bringing natural, intelligent voice interactions …Read More »
  • Victor Taichung at METALEX 2026: Advancing Smart Manufacturing in Southeast Asia

    November 16, 2026
    BANGKOK, Nov. 13, 2026 /PRNewswire/ …Read More »
  • Visa and Samsung Bring Scan to Pay to Mobile Devices Across Asia Pacific with Samsung Wallet

    November 16, 2026
    SINGAPORE, Nov. 16, 2026 /PRNewswire/ …Read More »
  • Our Brands
  • CybersecAsia
  • MartechAsia
  • Home
  • About Us
  • Contact Us
  • Sitemap
  • Privacy & Cookies
  • Terms of Use
  • Advertising & Reprint Policy
  • Media Kit
  • Subscribe
  • Manage Subscriptions
  • Newsletter

Copyright © 2026 DigiconAsia All Rights Reserved.