Meituan Accelerates Vision AI Inference Services
…With up to 60 cores per socket and support for 8-channel DDR5 memory, the processors improve memory bandwidth and speed while achieving higher memory bandwidth per PCIe 5 .0 (80 channels…
Search
CMCC Speeds Climate Change Modeling
…memory-bound code,” said Francesca Mele, who leads the NEMO group at the CMCC Advanced Computing Division. “That means it spends most of its execution time accessing memory to do the computation…
Accelerating Molecular Modeling
…By High performance computing (HPC) workloads typically default to targeting CPUs or GPUs. However, with powerful Intel® FPGA accelerators now available, this is changing. As demonstrated in this case study, an HPC…
UC Davis Accelerates GenAI for Data Visualization
…compute workloads, while Intel® Tiber™ AI Cloud provides the high-performance computing environment necessary to handle the complexity of our models. Figure 3. Examples of materials generated by our pipeline Intel® GPUs…
Enable Efficient LLM Inference with SqueezeLLM
…However, LLM inference is extremely resource intensive, requiring high-end computers for serving. Additionally, while prior machine learning workloads have been primarily compute-bound, generative LLM inference is predominantly memory-bandwidth bound…
Seekr: Building Trustworthy LLMs for Evaluating & Generating Content...
…Specifically on LLM inference, the large memory capacity of the Intel HPUs and GPUs has allowed us to adjust workload-specific parameters, such as batch sizes. On the software side, the various…
QCT Platform On Demand
…The QCT DevCloud Program provides access to the latest QCT QuantaGrid family of servers powered by Intel Xeon Scalable processors that deliver the performance and memory capacity for even the most compute…
Tech Mahindra Bridges India's Language Gap with AI
…In addition, the solution was optimized for non-uniform memory access (NUMA), a memory architecture where processors share some memory. Across India, 27 officially recognized languages have more than 1,600 dialects…
3D Tooth Segmentation Is Faster on Intel® Xeon® Scalable Processor
…The segmentation algorithm places specific demands on the computing and memory resources of medical institution equipment. Beyond necessitating substantial computing power for inference and result generation, the equipment must possess ample memory…
Open Source Software Drives HPC Innovation
…Intel’s HPC platforms deliver exceptional performance and scale with industry-first innovations in memory, computational performance, fabric and storage. In fact, a record 95 percent of all systems in the February…