I finally found an open-source local LLM that actually competes with cloud AI
… Open models got better when I wasn't looking Gemma 4 E4B wasn't what I expected from a free, local model. The image analysis holds up against cloud AI, dare I say. …
Search
Instead of paying $40 a month for cloud AI tools, I run everything through a local model on my gaming PC
… Related Local LLMs are actually good now, and I wasted months not realizing it I was wrong about them, and you might be too Your local model is probably already doing all of this Some of these tools do things a local model or runner genuinely can't, and for heavy or ongoing use, the paid versions m… …
I replaced the expensive Claude Pro subscription with these local models, and my productivity didn’t drop a bit
… Most local models lose the plot when you stack negative constraints like that, but Gemma’s instruction following felt sharp. …
I replaced ChatGPT, Claude, and Gemini on my phone with a local LLM, and it's a mobile upgrade I didn't expect
… Related I ditched LM Studio for llama.cpp, and my local LLM doesn't feel like a downgrade anymore My new main runner Ditching cloud AI apps for my new local model Impressive, but with trade-offs The actual chatting part was by far the most solid. …
Top stories
I ran a powerful local AI model on my laptop, and it didn’t feel like a compromise
2d agoI added this open-source tool to my local AI stack, and my local LLM finally has persistent memory
4d agoI ran Gemma 4 and Qwen 3.5 for the same local tasks, and one pulled miles ahead
1w agoI ditched LM Studio for an open-source alternative — and my local model is doing things it couldn't before
1w agoGoogle's Gemma 4 finally made me care about running local LLMs
… But I do want to briefly explain how local LLMs actually work, because it makes everything else in this piece make a lot more sense. You essentially download all of a model's trained weights, which are the files that contain everything the model has learned, onto your own machine. …
My local LLM rewrote my resume better than ChatGPT, and it's not even close
… Gigabyte GeForce RTX 5070 Ti Eagle OC Ice SFF See at Amazon Related I replaced the expensive Claude Pro subscription with these local models, and my productivity didn’t drop a bit Local-first vibe coding It's exciting to think where this all goes next The better model proved to be the one that paid… …
I tested 3 tiny local LLMs for everyday work, and only one of them impressed me
… Related I finally found a local LLM I want to use every day and it's not for coding Local AI that actually fits into my day Not toys, just specialists To be fair, I ran all three through the same two tests instead of tailoring prompts to each model's strengths, so the results skew toward what they … …
I ran a full LLM on my phone with no internet, and it's more useful than I expected
… The XDA AI Insider newsletter drops weekly with deep dives, tool recommendations, and hands-on coverage you won't find anywhere else on the site. Subscribe by modifying your newsletter preferences ! With a local LLM, an entire model has to fit on your device instead. …
I switched from NotebookLM to this open-source tool, and it does what Google won't
… The official docs even suggest using a small local model like gemma3 for summarization and document queries while pairing that with something heavier like OpenAI or Claude for the actual chat. …
I replaced NotebookLM with a local LLM, and the difference is night and day
… When it comes to prompting, local models respond a lot better to explicit instructions than cloud models do. …