• Inference is often always on, and is sensitive to latency and cost per request.
  • Agentic AI can compound that demand: one request may become a sequence of steps involving data retrieval, tool calls, code execution, coordination among multiple agents, and state that persists beyond a single request. That changes more than the amount of compute required. It changes the shape of the system.
  1. Adaptable: Infrastructure should allow organizations to match compute and other resources to the job at hand, rather than forcing every workload into the same architecture.
  2. Economical: This does not mean choosing the cheapest option. It means paying for the right tool for the job. Training may be a capital decision made periodically; inference can be an operating decision repeated at enormous scale. For agentic workloads, the more meaningful measure may be the cost of completing a task, rather than the cost of an individual token.
  3. Open: Broadly adopted standards can give customers more choice and reduce dependence on any single vendor’s product roadmap. Open interconnects and open networking can be particularly important here.
  • ✓ Build adaptable — so the future, whatever shape it takes, still fits.
  • ✓ Build economically — so you pay for the right tool rather than simply the biggest one.
  • ✓ Build openly, so you preserve choice.