At the recent Cloud Next conference, Google introduced Ironwood, its latest TPU (Tensor Processing Unit) AI accelerator chip, marking the seventh generation of the technology. This new chip is specifically optimised for inference tasks, which involve executing AI models, and will be available for Google Cloud customers later this year. Ironwood will offer two configurations: a 256-chip cluster and a larger 9,216-chip cluster.
According to Amin Vahdat, Vice President of Google Cloud, Ironwood is touted as the most advanced and energy-efficient TPU to date, crafted to effectively power large-scale inferential AI models. The launch comes as competition in the AI accelerator field intensifies, with major players like Nvidia leading the charge while rivals including Amazon and Microsoft are rolling out their proprietary solutions. Amazon has introduced its own chips, such as Trainium and Inferentia for its AWS service, while Microsoft has made its Maia 100 AI chip available through Azure.
In terms of performance, Ironwood boasts an impressive peak computation power of 4,614 TFLOPs, featuring 192GB of dedicated RAM and a bandwidth nearing 7.4 Tbps. It incorporates a new core, SparseCore, designed for handling complex data relevant to ranking and recommendation algorithms—useful in scenarios like suggesting products to users. Google asserts that this architecture reduces data movement and latency on the chip, leading to significant energy savings.
Additionally, Google plans to integrate Ironwood with its AI Hypercomputer, a modular computing cluster in its cloud services, as part of its future development roadmap. Vahdat highlighted that Ironwood signifies a significant advancement in AI inference capabilities, showcasing enhancements in computational power, memory, networking, and overall reliability.
In conclusion, Google’s Ironwood TPU appears poised to make a substantial impact on the AI landscape, positioning itself as a formidable competitor amid rising competition from other technology giants.
Fanpage:Â TechArena.au
Watch more about AI – Artificial Intelligence
