Your old GPU can still run big LLMs – you just need the right tweaks
…Quiz 8 Questions · Test Your Knowledge You don't need a beefy GPU to run a local LLM Trivia challenge Think you know your way around local AI? Test your knowledge of…
Search
All sources
xda-developers.com
62
phoronix.com
9
developer.nvidia.com
9
amd.com
5
theregister.com
4
appleinsider.com
3
bleepingcomputer.com
3
cnx-software.com
2
techpowerup.com
2
storagereview.com
2
android-developers.googleblog.com
2
huggingface.co
2
Videos
More videosTop stories
My local LLM can call Claude when it's stuck, and it changed everything about my local-first setup
1w agoInstead of paying $40 a month for cloud AI tools, I run everything through a local model on my gaming PC
1w agoI finally found an open-source local LLM that actually competes with cloud AI
1w agoA Modder Repurposed a Used V100 For LLM Acceleration
1w agoClaude Code with a local LLM running offline is the hybrid setup I didn't know I needed
…Why use a local LLM with Claude Code? Burning through cloud tokens only gets you so far Okay, while I could use Pi or OpenCode and still switch between the local LLM…
Select the right hardware for your local LLM deployment with this online guide - CNX Software
When it comes to deploying local LLMs, many people may think that spending more money will deliver more performance, but it’s far from reality. That’s why Sipeed created the “AI…
Speculative decoding made my local LLM actually usable
…Related Here's how I get the most out of my self-hosted LLM, especially when limited by VRAM Don't have an RTX 5090? No problem! Running a local LLM is…
Discussions and forums
Show HN: I built a RAG and knowledge graph agent that runs locally
Claw-Coder is an AI agent that runs locally on your laptop and has access to powerful tools instead of configuring claude or codex to use a local model just use claw-coder. Why was claw-coder created? Answer: To solve th…
7
7
Show HN: I built a powerful RAG and knowledge graph agent that runs locally
Claw-Coder is an AI agent that runs locally on your laptop and has access to powerful tools instead of configuring claude or codex to use a local model just use claw-coder.Why was claw-coder created? Answer: To solve the…
4
3
The Qwen 3.6 35B A3B hype is real!!!
My personal test for small local LLM intelligence is to check whether a model has any ability to understand the code that I write for my own academic research. My research is on some pretty niche topics and I doubt that …
Show HN: VerdictMail – IMAP daemon that uses LLM reasoning to catch phishing
I built VerdictMail as a homelab project to explore whether combining classical email authentication signals with LLM reasoning produces better threat classification than either approach alone.It runs as a daemon on Ub…
2
DeepSeek V4 being 17x cheaper got me to actually measure what I send to cloud vs what I could run locally. the results are stupid.
That foodtruck bench post showing deepseek v4 matching gpt-5.2 at 17x cheaper got me thinking. if frontier cloud models are that overpriced for equivalent quality, how much of my daily work even needs cloud at all? Ran m…
I built a local AI stack with 5 Docker containers, and now I'll never pay for ChatGPT again
…It makes my local LLM feel more proactive, not just reactive. SearXNG Connect your local LLM to a private internet SearXNG gives my local LLM access to real-time information without depending…
LM Studio's frontend was slowing me down, so I switched to this instead
…There is plenty of space for multiple ways to serve and interact with local LLMs, and the more, the better at this stage. It gives you local network access at a switch…
Google's Gemma 4 finally made me care about running local LLMs
…Local LLMs are something I don't talk about all that much, because it admittedly took me embarrassingly long to actually see their potential. The ones I tested initially were slow and…
I’d do these 5 things differently if I started self-hosting LLMs today
…Related Self-hosted LLM took my personal knowledge management system to the next level I upgraded my second brain with fully local intelligence. The local AI lab is a journey, not a…
I changed one setting in LM Studio, and it made my local LLM actually competitive with cloud models
…Sign in to your XDA account The longer I use my local LLMs , the more I realize how much of the "local models feel worse" experience is often just a settings problem…
I replaced ChatGPT and Claude with this powerful local LLM and saved over $20 a month while gaining full control
I replaced ChatGPT and Claude with this powerful local LLM and saved over $20 a month while gaining full control