Google must double AI serving capacity every 6 months to meet demand
Amin Vahdat, VP of Machine Learning, Systems and Cloud AI at Google, holds up TPU Version 4 at Google headquarters in Mountain View, California, on July 23, 2024. Marc Ganley Google ‘s AI infrastructure boss told employees that the company has to double its serving capacity every six months in order to meet demand for…
