I’d do these 5 things differently if I started self-hosting LLMs today
…Sign in to your XDA account I’ve been self-hosting LLMs for many months now, and the journey has been a wild mix of "aha!" moments and late-night troubleshooting sessions…
Search
Local LLMs are actually good now, and I wasted months not realizing it
…Sign in to your XDA account There's a version of local LLMs that lives in my head from how they were a couple of years ago. That they’re slow, clunky…
I tested 3 local LLMs on my actual work — and each model won at something different
…Sign in to your XDA account After getting started with local LLMs, I thought it was going to be a hunt to find the perfect model . That I just needed that one…
Your old GPU can still run big LLMs – you just need the right tweaks
xda-developers.com