… I went through this in detail with a drilldown on the “Zion” and “ZionEX” and “Grand Teton” hybrid CPU-GPU systems designed by Meta Platforms way back in October 2022 , showing how the DLRMs were just as parameter-intense and flops-hungry as the LLMs of the time. …
… That said, executives will continue to tout the co-design story, noting that ongoing software improvements and such offerings as reference architectures and AI factory designs will enable those chips and – despite their cost – make using them a cost advantage. inference ai mlperf
… Still, at least for the time being, GPUs and their highly parallel processing capabilities will continue to be the go-to chips for training large language models LLMs and for running some of AI inferencing jobs. …
… But with AI on the rise, it has stopped being specific about them and prefers now to talk about AI chips and systems versus other chips. …
… New Servers And More The PowerEdge XE9780 and XE9785 are air-cooled systems, with the XE9780L and XE9785L using direct-to-chip liquid cooling technology. …
… DDN partners closely with chip maker Nvidia. …