Tracked topic
… I have been trying to deploy deepseek-ai/DeepSeek-R1-Distill-Qwen-32B on inferentia with a context window higher than 4096 let's say MAX TOTAL TOKENS=8192 , but it seems there is no pre-compiled model for that. …
… MLA is not properly described in their paper, so it would be important to have code for this. · The code for the models are inside the model repositories, e.g. for V3: https://huggingface.co/deepseek-ai/DeepSeek-V3/blob/main/modeling deepseek.py Is it possible to contribute to this project? · Yes, … …
… Headline results DeepSeek-R1-Distill-Qwen-1.5B, 4K budget, 5 math benchmarks : LEAD reaches 53.36 acc / 3714 tokens / +0.68 AES, the only method that improves accuracy over base while reducing length. 📄 Paper: https://arxiv.org/abs/2605.09806 💻 Code: https://github.com/CrazyMint/LEAD 🤗 Model: https… …
… To remain expressive, the indexer uses many query heads for example, 64 on DeepSeek-V3.2 that share the same selected token set; this multi-head design is precisely what makes the indexer the dominant cost on long contexts. …
… According to DeepSeek's paper, DeepSeek-Distill-Qwen-7B's performance in MATH-500 and AIME24 is 92.8 and 55.5 respectively, which seems to be very different from the values in the table especially AIME24 . …
DeepSeek's reasoning skills are probably particularly useful for something like this. But in my mind, particularly for academic research type tasks, the propaganda baked into the model is a non-starter. I tested out the new DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-Unbiased model yesterday. …