Intel Unveils Gaudi 3 AI Accelerator and Xeon 6 Processors

The new chips aim to offer cost-effective AI and HPC performance, with Gaudi 3 priced significantly lower than Nvidia's H100.

Intel's Gaudi 3 AI accelerator features 64 tensor processor cores, 8 matrix multiplication engines, and 128GB of HBM2E memory.
Gaudi 3 offers up to 1856 BF16/FP8 matrix TFLOPS, but lags behind Nvidia's H100 in raw performance metrics.
Intel emphasizes Gaudi 3's lower total cost of ownership, with each unit priced around $15,625 compared to Nvidia's $30,678 H100.
The Xeon 6 processors come with performance cores that double AI vision performance and integrate AI acceleration capabilities.
Gaudi 3 and Xeon 6 systems will be available from major OEMs like Dell, HPE, and Supermicro starting in the fourth quarter of 2024.