Intel Launches Gaudi 3 AI Accelerator, Claiming Superior Performance and Efficiency Over Nvidia

Intel's new Gaudi 3 AI accelerator is touted to outperform Nvidia's H100 in both training and inference tasks, offering significant power efficiency and cost advantages.

Intel introduced the Gaudi 3 AI accelerator at the Vision 2024 event, claiming it delivers 50% faster training times and 40% better power efficiency compared to Nvidia's H100.
The Gaudi 3 is built on a 5nm process and features 128GB of HBM2e memory, designed for large-scale AI computations.
Intel's strategy focuses on providing a cost-effective, high-performance alternative to Nvidia, leveraging Ethernet over proprietary connections for enhanced scalability.
The new AI accelerator is available in multiple form factors, with volume production set to begin in Q3 2024.
Intel's move aims to capture more of the enterprise and data center markets, capitalizing on current supply constraints faced by Nvidia.