Does U.S. have enough AI capacity for agents?

Published 26/03/2025, 15:05
© Reuters

Investing.com -- The U.S. AI industry appears to have sufficient infrastructure to support the emerging wave of agentic products—software systems that perform complex tasks autonomously—but some questions remain around affordability and future scalability.

According to Barclays (LON:BARC), the industry is on track to have about 16 million accelerators online in 2025, with roughly 20% potentially available for agent inference workloads.

“Admittedly, most of this is running chatbots today, but we expect those products to be replaced eventually by much more capable agents,” Barclays analysts led by Ross Sandler said in a note.

Using a range of model assumptions, Barclays estimates the sector could support between 1.5 billion and 22 billion agents next year.

“Agents that run on expensive models (like OpenAI’s o1) result in lower capacity. More likely we expect most agentic products to run on lower cost models (like DeepSeek R1, Llama or Mistral),” the analysts said.

A move toward more efficient models like DeepSeek could enable the industry to support “15x more users” compared to the current state.

In terms of demand, enterprise adoption alone could be vast. According to Barclays, there is potential to replace over 1 billion enterprise software seat licenses and serve upwards of 10 billion enterprise tasks.

Consumer markets would add further pressure, with a global use base of more than 3 billion likely to “gobble up a huge percentage” of available inference compute.

“As the inference cost curve bends down further, and as more accelerators are installed, industry capacity would go up notably and be in a position to handle both consumer and enterprise agents,” analysts continued.

OpenAI’s anticipated “super agents”—with pricing ranging from $2,000 to $20,000 per month—may further stretch available capacity.

These agents are expected to consume significantly more tokens per query than chatbots, driving much higher compute needs. Agentic AI products have a notably higher token consumption trend compared to chatbots due to their autonomous nature.

The economics of agent subscriptions remain a key challenge. Products built on large proprietary models like OpenAI o1 may be “untenable” at consumer-friendly price points, whereas those using more efficient alternatives like DeepSeek R1 can operate at dramatically lower costs.

Salesforce’s (NYSE:CRM) Agentforce, for example, already runs on Mistral’s open-source models ranging from 7 billion to 141 billion parameters.

“As more inexpensive models become available (Llama 4 or DeepSeek R2) later this year, we should see this shift to lower-cost models powering agents accelerate,” analysts noted.

They expect the growing use of open-source models to ease cost pressures and extend scalability. But longer term, sustaining agent growth at scale will likely require “cheaper, smaller and similarly high performing foundation models,” more inference chips, and potentially a reallocation of training hardware toward inference workloads.

Latest comments

Risk Disclosure: Trading in financial instruments and/or cryptocurrencies involves high risks including the risk of losing some, or all, of your investment amount, and may not be suitable for all investors. Prices of cryptocurrencies are extremely volatile and may be affected by external factors such as financial, regulatory or political events. Trading on margin increases the financial risks.
Before deciding to trade in financial instrument or cryptocurrencies you should be fully informed of the risks and costs associated with trading the financial markets, carefully consider your investment objectives, level of experience, and risk appetite, and seek professional advice where needed.
Fusion Media would like to remind you that the data contained in this website is not necessarily real-time nor accurate. The data and prices on the website are not necessarily provided by any market or exchange, but may be provided by market makers, and so prices may not be accurate and may differ from the actual price at any given market, meaning prices are indicative and not appropriate for trading purposes. Fusion Media and any provider of the data contained in this website will not accept liability for any loss or damage as a result of your trading, or your reliance on the information contained within this website.
It is prohibited to use, store, reproduce, display, modify, transmit or distribute the data contained in this website without the explicit prior written permission of Fusion Media and/or the data provider. All intellectual property rights are reserved by the providers and/or the exchange providing the data contained in this website.
Fusion Media may be compensated by the advertisers that appear on the website, based on your interaction with the advertisements or advertisers
© 2007-2025 - Fusion Media Limited. All Rights Reserved.