…Using Docker Compose, if I want to test a new LLM or a vector database, I just add a few lines and run Docker-compose. There’s no more worrying about conflicting…
…It's time to cut some of them off and keep one cloud-based LLM to handle the bigger tasks my local LLMs can't handle. Related I used Claude and Gemini…
…I plan to test this setup with Qwen3.6-35B-A3B over the weekend, as I’m pretty sure it will work with a couple of tweaks. My local LLM pipeline essentially…
…Related I don't pay for ChatGPT, Perplexity, Gemini, or Claude – I stick to my self-hosted LLMs instead There's no point in relying on AI tools when my local LLMs…
…Qwen Qwen is a comprehensive family of advanced large language models (LLMs) and large multimodal models (LMMs). See at Github Related I replaced ChatGPT and Claude with this powerful local LLM and…
…I decided to pull the plug on my subscription and migrate my entire development and writing stack to local LLMs through LM Studio. And suddenly the capacity errors vanished, the privacy fears…
…Related I don't pay for ChatGPT, Perplexity, Gemini, or Claude – I stick to my self-hosted LLMs instead There's no point in relying on AI tools when my local LLMs…
…Sign in to your XDA account If you've spent any time running local LLMs, you know the drill. You find a model that's smart enough but too slow, or fast…
…Sign in to your XDA account If you've spent any time running local LLMs, you've probably hit the same wall I have. You find the perfect model quantized to 4…
…Well, it's official — we've finally gotten to the point where we can just have an LLM dawdle around and do its own thing for our amusement. Granted, watching an LLM…