Tracked topic
… NVIDIA Blackwell NVFP4 Architecture Delivers Major Speed-Ups In DeepSeek v4 With More Optimizations On The Way With the launch of DeepSeek V4, we saw some major optimizations in compute & memory requirements. …
… How DeepSeek V4 Slashes Compute and Memory Costs In its release notes for DeepSeek V4, DeepSeek outlines that the new model is capable of using just 27% of single-token inference FLOPs and 10% of key-value KV cache when running a one-million-token context window. …
… It would be interesting to see how DeepSeek's R2 AI model, which is expected to debut in a few weeks, turns out. …
… My math yields 22.4% MFU tho https://t.co/HD3iNLFxbA pic.twitter.com/TeZexTHyby — Teortaxes▶️ DeepSeek 推特🐋铁粉 2023 – ∞ @teortaxesTex January 25, 2025 Of course, DeepSeek claims that its R1 model was trained on just 2000 H800 GPUs. …
… Read all comments on Microsoft Risks Trump’s Ire By Abandoning The Costly OpenAI And Anthropic Models For China-Based DeepSeek’s V4 Model For Enterprise Workloads
… The two benchmarks demoed are listed below: Decode: DeepSeek-R1-0528 671B up to 350+ tokens/second/user –– faster than the fastest inference systems from Groq and Cerebras in performance and capacity supporting batch sizes from 8 to 64 and up to 128k context Running on 16 Galaxy servers Prefill: De… …
… Related Story Tenstorrent Vows to ‘Crush Everyone’ as Galaxy Blackhole Hits 350 Tokens/s on DeepSeek R1, Undercutting NVIDIA’s GB300 5x AI TCO DeepSeek performing very well on @AMDRadeon 7900 XTX. …
… Read all comments on Here’s How NVIDIA’s Blackwell Ultra GB300 AI Racks Are Dominating Long-Context DeepSeek Workloads, Delivering Impressive Gains Versus GB200
… Read all comments on AMD’s vLLM-ATOM Plugin Supercharges DeepSeek-R1, Kimi-K2, and gpt-oss-120B AI LLM Inference on Instinct MI350 and MI400 Accelerators
… Zyphra Cloud - The DeepSeek of China Is Here & It Is Powered By An All-AMD Powerhouse With 15MW of Compute Through MI355X & Expansion To Future GPUs The Zyphra AI Cloud platform is an inference-optimized service for frontier open-weight models such as DeepSeek V3.2, Kimi K2.6, and GLM 5.1. …