AI Infra Summit: NVIDIA Vera Rubin and DSX Platform Advancements Showcase Energy Efficiencies of Optimizing Tokens Per Watt for AI Factories
Article image or reusable cover for NVIDIA
NVIDIA presented its latest advances in energy-efficient AI infrastructure at the AI Infra Summit, focusing on maximizing AI tokens per megawatt of power rather than raw processing capability alone.
Lambda improved performance per watt by 23 percent using NVIDIA's DSX MaxLPS software, and Emerald AI demonstrated how AI factories can adjust power consumption based on grid demand. NVIDIA DSX MaxLPS can deliver up to 1.4x more tokens per megawatt through factory-wide optimization and enable up to 40 percent more GPU capacity within the same power budget for Vera Rubin systems.
The metric for AI infrastructure is fast shifting from peak performance to validated agentic tokens per megawatt.
Read the full story at NVIDIA →
Vibekollen prepared this summary with AI from the original publication. The content belongs to NVIDIA.