Local AI isn't just Ollama—here's the ecosystem that actually makes it useful
…Related I don't pay for ChatGPT, Perplexity, Gemini, or Claude – I stick to my self-hosted LLMs instead There's no point in relying on AI tools when my local LLMs…
Search
All sources
xda-developers.com
73
phoronix.com
6
amd.com
6
developer.nvidia.com
6
intel.com
4
bleepingcomputer.com
3
cnx-software.com
2
techradar.com
2
techpowerup.com
2
storagereview.com
2
android-developers.googleblog.com
2
huggingface.co
2
Videos
More videosTop stories
These 5 small tweaks made my self-hosted LLM setup way more productive
2d agoMy self-hosted LLMs are a lot more than just a chat replacement – here's how they boost my productivity
3d agoI use Claude and local LLMs together now, and it costs half as much while being twice as fast
5d agoMy local LLM can call Claude when it's stuck, and it changed everything about my local-first setup
1w agoGoogle's Gemma 4 finally made me care about running local LLMs
…Local LLMs are something I don't talk about all that much, because it admittedly took me embarrassingly long to actually see their potential. The ones I tested initially were slow and…
I’d do these 5 things differently if I started self-hosting LLMs today
…Related Self-hosted LLM took my personal knowledge management system to the next level I upgraded my second brain with fully local intelligence. The local AI lab is a journey, not a…
I changed one setting in LM Studio, and it made my local LLM actually competitive with cloud models
…Sign in to your XDA account The longer I use my local LLMs , the more I realize how much of the "local models feel worse" experience is often just a settings problem…
Discussions and forums
Show HN: I built a RAG and knowledge graph agent that runs locally
Claw-Coder is an AI agent that runs locally on your laptop and has access to powerful tools instead of configuring claude or codex to use a local model just use claw-coder. Why was claw-coder created? Answer: To solve th…
7
7
Show HN: I built a powerful RAG and knowledge graph agent that runs locally
Claw-Coder is an AI agent that runs locally on your laptop and has access to powerful tools instead of configuring claude or codex to use a local model just use claw-coder.Why was claw-coder created? Answer: To solve the…
4
3
The Qwen 3.6 35B A3B hype is real!!!
My personal test for small local LLM intelligence is to check whether a model has any ability to understand the code that I write for my own academic research. My research is on some pretty niche topics and I doubt that …
Show HN: VerdictMail – IMAP daemon that uses LLM reasoning to catch phishing
I built VerdictMail as a homelab project to explore whether combining classical email authentication signals with LLM reasoning produces better threat classification than either approach alone.It runs as a daemon on Ub…
2
DeepSeek V4 being 17x cheaper got me to actually measure what I send to cloud vs what I could run locally. the results are stupid.
That foodtruck bench post showing deepseek v4 matching gpt-5.2 at 17x cheaper got me thinking. if frontier cloud models are that overpriced for equivalent quality, how much of my daily work even needs cloud at all? Ran m…
I finally found an open-source local LLM that actually competes with cloud AI
…Related I finally found a local LLM I want to use every day (and it's not for coding) Local AI that actually fits into my day Google built one of the…
I replaced ChatGPT and Claude with this powerful local LLM and saved over $20 a month while gaining full control
I replaced ChatGPT and Claude with this powerful local LLM and saved over $20 a month while gaining full control
I made Claude slower and it completely changed how I use it
…It’s about controlling how you consume LLM outputs. And that doesn’t require any tool or extension at all. Related I finally found a local LLM I actually want to use…
Building a local LLM news brief taught me my real problem wasn't the sources, it was the apps
…That made the daily brief feel intentional before the LLM even touched it . The local LLM’s job was not to discover the entire internet for me. It was there to read…
Ollama is still the easiest way to start local LLMs, but it's the worst way to keep running them
…Quiz 8 Questions · Test Your Knowledge Ollama & Local LLMs Trivia Challenge Think you know your way around running AI models locally — put your Ollama expertise to the test! Setup Models Commands Privacy…
I turned my phone into a local LLM server, and it handles vision, voice, and tool calls
…Sign in to your XDA account Running a local LLM has typically required you to either have some pretty beefy hardware, or to buy dedicated hardware if you didn't have it…