Inference

Google Details Ironwood TPU Superpods Built for Inference at Cloud Scale

Google pitches a vertically integrated silicon-to-software system to cut latency and cost per query for large-scale AI serving.