I ditched Claude for Obsidian and a local LLM, and miss it less than I expected to
…Now, I've been running better models such as Qwen 3.5 9B and Gemma 4 E4B , and have also tested various local LLM runners beyond LM Studio. But I still did…
Tracked topic
Gemma is a family of open-weight language models released by Google for text generation and related NLP tasks.
…Now, I've been running better models such as Qwen 3.5 9B and Gemma 4 E4B , and have also tested various local LLM runners beyond LM Studio. But I still did…
…version seems to be built on Gemma 3. There's not much difference between the models for what OMNI can handle, and they run locally on your device, so you get privacy…
…Related Your old GPU can still run big LLMs – you just need the right tweaks There's a lot you can do with these models Integrating local LLMs with VS Code increased…
…Sign in to your XDA account Despite the productivity-oriented perks of large language models, there’s the misconception that local LLMs need a lot of computational horsepower to run. Well, it…
…switching over to vLLM and the Gemma 4 model I had running there. This didn't go so well. At least it installed the custom provider alright, but nothing worked when I…
…And that wasn't completely baseless - I'd tried Google's Gemma-3n-E4B before, which runs on a completely different architecture, and it kind of confirmed that bias.The context window…
…The extension can even spin up a llama.cpp environment But I’ve paired it with bulky models running on local llama-server instances As for the models, llama-vscode includes built…
…Sign in to your XDA account I’ve started pairing my FOSS applications with self-hosted LLMs running on my Ollama and LM Studio instances, and AI-powered workflows have made my…
…Ollama is, for better or worse, how a lot of people interact with local LLMs for the first time. It's the tool that makes running models as simple as ollama run…
…But I also have Gemini open half the time, Qwen running locally almost every day, and a couple of other AI tools in rotation, none of which I'm paying for. So…