I ran a local LLM on my underpowered Chromebook, and it actually works
…Setting up my Chromebook with a local LLM Getting it running through Android The obvious path here is Termux, which would let me drop in llama.cpp or Ollama and run a…
Search
Related topics:
Google Gemma
Tracked topic
Google Gemma
Gemma is a family of open-weight language models released by Google for text generation and related NLP tasks.
High-VRAM GPUs aren't the future of local AI — unified memory and Mixture of Experts models are
…For the last few years, the path to running bigger models locally was simply buying a card with more VRAM. That path has quietly hit a wall in recent years. Consumer VRAM…
I ditched LM Studio for llama.cpp, and my local LLM doesn't feel like a downgrade anymore
…Literally all it took was downloading, unzipping, running one command in the terminal, and that's it. llama.cpp is an open-source C++ runtime for running large language models locally, built…
My self-hosted LLMs are a lot more than just a chat replacement – here's how they boost my productivity
…centered around my local models Besides my coding tasks, LLMs are just as valuable for my FOSS arsenal. For example, I’ve connected the llama-server running Gemma4-26B-A4B to my…
Top stories
I split my coding work between Claude, Qwen3-Coder and Gemma 4, and it costs less than paying for one subscription
3d agoI solved Gemma 4's biggest problem by routing it through Claude, and all it took was a Python script
1w agoI tested Google's new Gemma 4 12B on my 8GB GPU, and now I don't want to go back to smaller models
1w agoI ran Gemma, Llama, and Qwen on my phone, and only one of them is worth the storage
1w agoTwo days without internet taught me why local LLMs are worth the setup
…None of this would normally be a great week, but I got more done than I expected to, and most of that comes down to having a local LLM setup that runs…
I replaced cloud LLMs with local models running off a Proxmox LXC, and the performance trade-off was worth it
…After migrating through a bunch of setups, I’ve honed in on a local LLM server running on my old Proxmox workstation, and it works surprisingly well for everything from simple prompting…
I ran this bulky LLM on an SBC cluster, and it's the most unhinged setup I've ever built
…Related I replaced ChatGPT and Claude with this powerful local LLM and saved over $20 a month while gaining full control Qwen3.6 runs on my old GPU and does what ChatGPT…
The biggest local LLM on your machine is useless if it can't call a single tool, no matter how many parameters it has
…835, which is pretty solid. Gemma 3 4B got 0.733. Llama 3.2 3B got 0.727. These are all local models you can run on consumer hardware. And then there…
Running local AI on the Raspberry Pi 5 taught me why cloud models are still winning
…Right now, AI is designed to run in the cloud. Running it locally is cool, but it's not fully there yet. Once the technology improves, however, I could really see running…
I tried PewDiePie's open-source AI workspace, and it's weirdly great
…For the local model, I had LM Studio already running with Gemma 4 E4B loaded. If you're doing the same, just flip on "Serve on Local Network" so Docker can actually…