Tracked topic
Qwen3 is an AI model family developed by Alibaba, released as a set of large language models for natural-language tasks.
…Alongside this release, Qwen3-8B support has expanded with 4B and .6B models. This offers developers a choice when balancing speed, quality, and memory usage when integrating these models at runtime. Nsight…
…80GB Qwen3 30B a3B 1.2 9,058 tokens/sec/gpu 16x H100 NVIDIA DGX H100 nemo:26.02.01 4096 1 2 1 8 FP8 1024 H100-SXM5-80GB Qwen3 235B…
…I was able to perform a rough comparison between Dots.OCR.Runner and other VLMs such as Magistral-Small-2509 and qwen3-vl-30b , using their top quantized versions that can run…
["google-gemma","google","qwen3"]
Qwen3.6-35B-A3B speculative decoding is net-negative on RTX 3090
We got 207 tok/s with Qwen3.5-27B on an RTX 3090
https://w418ufqpha7gzj-80.proxy.runpod.netStarted for myself, but since Im not using it continuously, sharing it:Open Access Qwen3.6-35B-A3B-UD-Q5_K_M with TurboQuant (TheTom/llama-cpp-turboquant) on RTX 3090 (Runpod spo…
https://preview.redd.it/42ak5qmus82h1.png?width=1133&format=png&auto=webp&s=744ea3dfc06c83d0c4d8aa128c39b3238b17d7be Qwen 3.7 Max sitting at 5th, pretty much on par with GPT 5.4 (xhigh) and a notch above the just release…
My workflow has changed basically to ask Codex to do certain tasks and then document how to do them (including errors it found on its way) into a skill. I feed that skill to pi, and suddenly my qwen3.6 gets that hard stu…
…Related I replaced ChatGPT and Claude with this powerful local LLM and saved over $20 a month while gaining full control Qwen3.6 runs on my old GPU and does what ChatGPT…
…On my main PC, I’ve got an RTX 3080 Ti running Qwen3.6-35B-A3B , and I use it for the majority of my VS Code tasks. But for the rest…
…According to Mistral, Leanstral-120B-A6B outperforms larger (more parameters) open source rivals like GLM5-744B-A40B, Kimi-K2.5-1T-32B, and Qwen3.5-397B-A17B on FLTEval. But perhaps more…
…After entering the LLM model name and the context window, I've now got Qwen3-Coder-Next as my coding companion and am using my workstation GPU to its full potential. Visual…
…ollama pull qwen3.5:9b Next, install Claude Code. Then point Claude Code at your local Ollama server instead of Anthropic's API by setting the environment variables. npm install -g @anthropic…
…Putting it all together, we compress Qwen3-Next-80A3B to a 23A2B model that retains competitive performance. These results offer practical guidance for efficient MoE compression at scale. View arXiv page View…
