I tried caring about ChatGPT and Claude, but I still haven't found a real need for LLMs
…Related I run local LLMs daily, but I'll never trust them for these tasks Your local LLM is great, but it'll never compare to a cloud model. I've used…
Search
All sources
xda-developers.com
25
developer.nvidia.com
6
amd.com
2
intel.com
2
phoronix.com
1
press.asus.com
1
research.google
1
Top stories
My self-hosted LLMs are a lot more than just a chat replacement – here's how they boost my productivity
3d agoLocal LLMs perform so much better when you teach them to ask before they answer
4d agoTrying to self-host LLMs made me realize local AI has a friction problem, not a quality problem
5d agoMy local LLM can call Claude when it's stuck, and it changed everything about my local-first setup
1w agoSpeculative decoding made my local LLM actually usable
…Local LLM performance is about how you run it, not just about what you run. You don't always need a better model. Sometimes you just need to stop making the one…
I started using my local LLMs and an MCP server to manage my NAS – it's surprisingly powerful (and safe)
…from my local LLM clients into API calls that my TrueNAS rigs can understand. So, I can issue typical commands to my LLMs, and they’ll have no trouble performing the specified…
I thought I needed a GPU for local LLMs until I tried this lean model
…Sign in to your XDA account When it comes to local LLMs, we have been told that if you aren’t packing a high-end GPU with a massive pool of VRAM…
Discussions and forums
The Qwen 3.6 35B A3B hype is real!!!
My personal test for small local LLM intelligence is to check whether a model has any ability to understand the code that I write for my own academic research. My research is on some pretty niche topics and I doubt that …
Getting a feel for how fast X tokens/second really is.
I love following all your adventures with local LLM setups. Quality and size of the models are important, but so is performance. Numbers don't really convey the experienced speed well, however. If someone claims they run…
Qwen 3.6 27B vs Gemma 4 31B - making Packman game!
Gemma just crushed Qwen in a local LLM gamedev contest! Device: MacBook Pro M5 Max, 64GB RAM Qwen 3.6 27B: 32 tokens/sec · 18m 04s · 33,946 tokens. Gemma 4 31B: 27 tokens/sec · 3m 51s · 6,209 tokens. So what is more impo…
M5 vs DGX Spark vs Strix Halo vs RTX 6000
Hey guys, super simple. There have been a lot of online debates about the new M5 Macs vs DGX Sparks vs Strix Halo vs dedicated GPUs etc. So I put them all in a room with good power and cooling and ran everything in paral…
Unpopular Opinion: The DGX Spark Forum community of devs is talented AF and will make the crippled hardware a success through their sheer force of will.
There is a lot of disdain for DGX Sparks here on the sub. And I get it. A lot of people say “It could have been great if it had been better memory bandwidth”, “SM-121 is a fake /second-class Blackwell chip” yadda, yadda.…
I ran this bulky LLM on an SBC cluster, and it's the most unhinged setup I've ever built
…Sign in to your XDA account Ever since I jumped headfirst into the local LLM rabbit-hole, I’ve grown fond of revitalizing old PCs by turning them into reliable AI workstations…
I built a local LLM server I can access from anywhere, and it uses a Raspberry Pi
…But it’s semi-decent at running tiny LLMs on its own web UI, and even remains accessible from remote networks. Related I ran local LLMs on a "dead" GPU, and the…
LM Studio's frontend was slowing me down, so I switched to this instead
…There is plenty of space for multiple ways to serve and interact with local LLMs, and the more, the better at this stage. It gives you local network access at a switch…
Ollama is still the easiest way to start local LLMs, but it's the worst way to keep running them
…Quiz 8 Questions · Test Your Knowledge Ollama & Local LLMs Trivia Challenge Think you know your way around running AI models locally — put your Ollama expertise to the test! Setup Models Commands Privacy…
I’d do these 5 things differently if I started self-hosting LLMs today
…Related Self-hosted LLM took my personal knowledge management system to the next level I upgraded my second brain with fully local intelligence. The local AI lab is a journey, not a…
Claude Code with a local LLM running offline is the hybrid setup I didn't know I needed
…Why use a local LLM with Claude Code? Burning through cloud tokens only gets you so far Okay, while I could use Pi or OpenCode and still switch between the local LLM…