Majestic’s 128TB AI Server Aims to Smash the LLM Memory Wall
… That’s over 60 times more than Nvidia’s DGX B300 server , a cutting-edge AI processing rack. …
… That’s over 60 times more than Nvidia’s DGX B300 server , a cutting-edge AI processing rack. …
… Tensordyne claims its 72-chip system can run large LLMs four times as fast using one-fifth the power compared to a 72-Nvidia GB300 system. …
… The recently released B300 uses eight HBM chips, each of which is a stack of 12 DRAM dies. Competitors’ use of HBM has largely mirrored Nvidia’s. …