Tracked topic
Gemma is a family of open-weight language models released by Google for text generation and related NLP tasks.
…Qwen 3.5 9B is the one that runs smoothly, and I think a lot of that is the Gated DeltaNet architecture doing the work. Gemma 4 E4B runs just as smoothly…
…Sign in to your XDA account Summary Running a local Gemma4 on my RTX 4070 Ti let me prototype my dream game offline. A spreadsheet+Python rebuilt the persistent world, so I…
…For the local side of this pipeline, I went with Google's Gemma 4 26B model . It is highly capable, runs comfortably on my RTX 4070 Ti Super (notably, without the overhead…
…Related I ran local LLMs on Intel's cheapest iGPU, and the results were surprisingly decent It ain't no match for a dedicated GPU, but you can run some light LLMs…
…Don't let local AI scare you off Before we go any further, don't let the phrase "local AI" send you running for the hills. A few years ago, running AI…
…The Gemma 4 E4B I run on desktop is technically 8B parameters loaded, and the E2B variant designed for phones is 5B. I'd been imagining a real gulf between "serious" self…
…The same logic could be applied in a disaggregated fashion, where a routing model running locally could direct prompts requiring access to proprietary data to a local LLM, while less sensitive requests…
I made my first macOS utility app that ships with a bundled Gemma 4 model, specifically the Gemma E4B one. It made my app DMG have 5.3 GB in size, but I think it is a small size for the power that this free local model c…
Gemma just crushed Qwen in a local LLM gamedev contest! Device: MacBook Pro M5 Max, 64GB RAM Qwen 3.6 27B: 32 tokens/sec · 18m 04s · 33,946 tokens. Gemma 4 31B: 27 tokens/sec · 3m 51s · 6,209 tokens. So what is more impo…
Hi guys.I have been working on Hitoku Draft, an open-source, voice-first AI assistant that runs entirely locally. I posted about it already, and now it has also transcription with voice editing. Looking for feedback, as …
Update from the lawyer with the V100 server. A few of you asked what I actually ended up running once the dust settled, so here it is. Still just a lawyer, still driving the whole thing through Claude Code, still not ful…
Claude Code like agentic workflow ai too costly for me.Any LLM can I run with VSCode at the below setup? 16ram Intel core i7 h processor 13gen 512gb NVMe SSD I want to run the ai as local agentic workflow with Vscode.I w…
…Ollama specializes in open-weight models like Llama 3, Mistral, and Gemma that can be legally downloaded and run locally. 04 / 8 Hardware When running an LLM with Ollama, what hardware component…
…Open Notebook's docs literally use gemma3 as the example local model, it's well-supported in Ollama with proper caching, and it runs fine on modest hardware. One command pulls it…
…Both models were running locally through Ollama, and I used the same prompts whenever possible to keep the comparison fair. Instead of asking each model to generate random stories or solve benchmark…