Ubuntu just showed Microsoft how to add AI without the mess
…with this powerful local LLM and saved over $20 a month while gaining full control Qwen3.6 runs on my old GPU and does what ChatGPT does for free A lot of…
Search
Related topics:
LLMs
I replaced my ChatGPT subscription with a local AI coding tool and haven't looked back
…For Qwen2.5-Coder 32B, you'd need around 20GB of VRAM to run it completely on the GPU. Cards like the RTX 3090, RTX 4090, and, obviously, newer models can handle…
I don't need Claude, this is the local LLM I run on my NAS that powers my smart home
…need Claude, but a local model that's realistic for your hardware, and Qwen 2.5 fits that role well. Qwen Qwen is a comprehensive family of advanced large language models (LLMs…
I turned my Raspberry Pi into a pocket Linux server that runs from a power bank, and it's weirdly useful
…As for the tools, I began deploying lightweight utilities that I might need while I’m away from my goblin cave. Pairdrop was the first tool I spun up, and after confirming…
Top stories
AMD just dropped a compact AI workstation that makes discrete GPUs look outdated for running LLMs
6d agoI built my own Googlebook with a Raspberry Pi, local LLMs, and old hardware
1w agoI added a second GPU just for local AI workloads, and it cost less than upgrading my main one
1w ago13 years later, the GTX Titan is still the most important GPU Nvidia ever made
1w agoI replaced the expensive Claude Pro subscription with these local models, and my productivity didn’t drop a bit
…Of course, these are just my preferred LLM models for my workflow. You shouldn’t hold yourself back from exploring other LLMs based on your hardware setup and workflow.
Intel's New Arc Pro GPUs show what the consumer cards should have been
…Related 3 reasons I really want Intel to release another Battlemage GPU We all need the Intel Battlemage train to keep going Battlemage at high-end was always the GPU gamers needed…
I stopped trusting cloud AI with my personal files, and switched to this local setup instead
…As for backup: my tried and true, encrypted little physical hard drive. There's no need for massive cloud storage for text and PDF files. Related 4 reasons Open Notebook is the…
I fine-tuned a 7B model to write my Home Assistant automations, and it actually works
…particular, action calls need exact entity IDs, and Jinja2 templates for anything beyond basic triggers can get messy fast. I've seen people try to use cloud LLMs to varying degrees of…
Running local AI on the Raspberry Pi 5 taught me why cloud models are still winning
…Related I started self-hosting LLMs and absolutely loved it Who needs OpenAI when your home lab can do the thinking for you? However, finding a device to install them on seemed…
PCIe 5.0 SSDs only benefit two workloads, and gaming isn't one of them
…As for LLM training, large datasets and models can encounter slowdowns on slower storage, making Gen5 drives well worth the premium. For professionals, the investment is recouped in no time, and for…