Inference now drives two-thirds of AI workloads, changing where chips get deployed

Posted

AI spending is shifting from giant training clusters toward smaller, quickly built sites, and modular data centers are becoming a natural home for inference workloads. Power, cooling and memory supply now shape where tokens get generated as much as raw chip performance does. Inference-first chipmakers want to capture that shift. Positron AI Inc., which raised […]

The post Inference now drives two-thirds of AI workloads, changing where chips get deployed appeared first on SiliconANGLE.



Continue reading at SiliconANGLE »

AI, Cube Event Coverage, NEWS, #SC26, AI data centers, AI inference, artificial intelligence, Cameron McCaskill, high bandwidth memory, inference chips, John Furrier, modular data centers, oracle, Positron AI, Rebecca Knight, SC26eventpage, Supercomputing, sustainable computing, NYSE:ORCL, NASDAQ:QNT