I tested 3 tiny local LLMs for everyday work, and only one of them impressed me
I tested 3 tiny local LLMs for everyday work, and only one of them impressed me
Search
All sources
xda-developers.com
73
phoronix.com
6
amd.com
6
developer.nvidia.com
6
intel.com
4
bleepingcomputer.com
3
cnx-software.com
2
techradar.com
2
techpowerup.com
2
storagereview.com
2
android-developers.googleblog.com
2
huggingface.co
2
Videos
More videosTop stories
These 5 small tweaks made my self-hosted LLM setup way more productive
2d agoMy self-hosted LLMs are a lot more than just a chat replacement – here's how they boost my productivity
3d agoI use Claude and local LLMs together now, and it costs half as much while being twice as fast
5d agoMy local LLM can call Claude when it's stuck, and it changed everything about my local-first setup
1w agoIntel's $949 GPU has 32GB of VRAM for local AI, but the software is why Nvidia keeps winning
…The hardware is real, and there are ways to make it work for local AI, but the experience getting there makes it harder than it should be. I've tested local LLMs…
Your old GPU can still run big LLMs – you just need the right tweaks
…Quiz 8 Questions · Test Your Knowledge You don't need a beefy GPU to run a local LLM Trivia challenge Think you know your way around local AI? Test your knowledge of…
Claude Code with a local LLM running offline is the hybrid setup I didn't know I needed
…Why use a local LLM with Claude Code? Burning through cloud tokens only gets you so far Okay, while I could use Pi or OpenCode and still switch between the local LLM…
Discussions and forums
Show HN: I built a RAG and knowledge graph agent that runs locally
Claw-Coder is an AI agent that runs locally on your laptop and has access to powerful tools instead of configuring claude or codex to use a local model just use claw-coder. Why was claw-coder created? Answer: To solve th…
7
7
Show HN: I built a powerful RAG and knowledge graph agent that runs locally
Claw-Coder is an AI agent that runs locally on your laptop and has access to powerful tools instead of configuring claude or codex to use a local model just use claw-coder.Why was claw-coder created? Answer: To solve the…
4
3
The Qwen 3.6 35B A3B hype is real!!!
My personal test for small local LLM intelligence is to check whether a model has any ability to understand the code that I write for my own academic research. My research is on some pretty niche topics and I doubt that …
Show HN: VerdictMail – IMAP daemon that uses LLM reasoning to catch phishing
I built VerdictMail as a homelab project to explore whether combining classical email authentication signals with LLM reasoning produces better threat classification than either approach alone.It runs as a daemon on Ub…
2
DeepSeek V4 being 17x cheaper got me to actually measure what I send to cloud vs what I could run locally. the results are stupid.
That foodtruck bench post showing deepseek v4 matching gpt-5.2 at 17x cheaper got me thinking. if frontier cloud models are that overpriced for equivalent quality, how much of my daily work even needs cloud at all? Ran m…
Select the right hardware for your local LLM deployment with this online guide - CNX Software
When it comes to deploying local LLMs, many people may think that spending more money will deliver more performance, but it’s far from reality. That’s why Sipeed created the “AI…
AMD just dropped a compact AI workstation that makes discrete GPUs look outdated for running LLMs
…So, yes, we're talking super-large LLMs. Related I finally found a local LLM I want to use every day (and it's not for coding) Local AI that actually fits…
Speculative decoding made my local LLM actually usable
…Related Here's how I get the most out of my self-hosted LLM, especially when limited by VRAM Don't have an RTX 5090? No problem! Running a local LLM is…
Trying to self-host LLMs made me realize local AI has a friction problem, not a quality problem
…Ollama Ollama is a platform to download and run various open-source large language models (LLM) on your local computer. See at Ollama Related My local LLM can call Claude when it…
I built a local AI stack with 5 Docker containers, and now I'll never pay for ChatGPT again
…It makes my local LLM feel more proactive, not just reactive. SearXNG Connect your local LLM to a private internet SearXNG gives my local LLM access to real-time information without depending…
LM Studio's frontend was slowing me down, so I switched to this instead
…There is plenty of space for multiple ways to serve and interact with local LLMs, and the more, the better at this stage. It gives you local network access at a switch…