Google Unveils Trillium TPUs with Major Performance Leap

The sixth-generation AI chips promise a 4.7x boost in compute performance and increased energy efficiency.

Trillium TPUs deliver 4.7 times the compute performance of their predecessors.
The new chips feature expanded matrix multiply units and doubled memory bandwidth.
Google's third-gen SparseCore accelerator enhances processing of large embeddings.
The TPUs are 67% more energy-efficient than the previous generation.
Available to cloud customers in late 2024, Trillium will support larger AI models and concurrent users.