AR / VR – NVIDIA Technical Blog
…Your Essential Tool for Measuring GPU Interconnect and Memory Performance When you’re writing CUDA applications, one of the most important things you need to focus on to write great code is…
Search
Related topics:
LLMs
All sources
xda-developers.com
37
developer.nvidia.com
29
blogs.nvidia.com
14
amd.com
7
theregister.com
3
intel.com
3
phoronix.com
2
wccftech.com
2
press.asus.com
2
huggingface.co
2
extremetech.com
1
cnx-software.com
1
Videos
More videosDeveloper Tools & Techniques – NVIDIA Technical Blog
…Your Essential Tool for Measuring GPU Interconnect and Memory Performance When you’re writing CUDA applications, one of the most important things you need to focus on to write great code is…
Launching AMD AI Playbooks: Step-by-Step Guides for Building with AI Locally with AMD
…Who they are for? AI Playbooks are written for developers who are comfortable with the basics: The command line Python environments Basic AI/ML concepts You don’t need deep expertise in…
Optimized Software for Professionals With AMD and ISV Solutions
…Epic Games AMD partners with Epic Games to optimize Unreal Engine for peak performance on AMD CPUs and GPUs, delivering enhanced graphics and speed for developers and users. Maxon AMD and Maxon…
Top stories
Trying to self-host LLMs made me realize local AI has a friction problem, not a quality problem
5d agoAMD just dropped a compact AI workstation that makes discrete GPUs look outdated for running LLMs
1w agoI added a second GPU just for local AI workloads, and it cost less than upgrading my main one
1w ago13 years later, the GTX Titan is still the most important GPU Nvidia ever made
1w agoWinning Health Optimizes LLMs in Healthcare
…The fact that the solution manages to use CPU for inference means healthcare institutions can flexibly allocate CPU’s computing power between LLM inference and other IT applications as needed, which improves…
CEO Interview with Adi Gelvan of Speedata - Semiwiki
…What new features/technology are you working on? Our near-term development is focused on deeper optimization for agentic analytics workloads as enterprises increasingly need to run LLM queries against large, structured…
n8n, Dify, and Ollama might be the best self-hosted AI automation stack right now
…First is connecting different apps and systems, second is building LLM apps and RAG workflows, and third is running models locally for privacy. n8n fits into the first layer. It’s built…
Discussions and forums
My first 10 inch rack with local LLM! No more Spotify, Google Home, Netflix, ChatGPT...
I'm pretty new to homelabbing and this is my first mini rack! Started with the Beelink ME Mini and then just kinda grew from there (it's always the way hey haha). It idles at 70 watts (not too shabby for how much is goin…
Computer build using Intel Optane Persistent Memory - Can run 1 trillion parameter model at over 4 tokens/sec
As the title states, my build is indeed able to run a 1 trillion parameter model (in this case Kimi K2.5) locally at ~4 tokens/second. I thought r/LocalLLaMA would be interested in the build due to that stat line, and al…
80 tok/sec and 128K context on 12GB VRAM with Qwen3.6 35B A3B and llama.cpp MTP
Just wanted to share my config in hopes of helping other 12GB GPU owners achieve what I see as very respectable token generation speeds with modest VRAM. Using the latest llama.cpp build + MTP PR, I got over 80 tok/sec w…
2.5x faster inference with Qwen 3.6 27B using MTP - Finally a viable option for local agentic coding - 262k context on 48GB - Fixed chat template - Drop-in OpenAI and Anthropic API endpoints
2026-05-07 edit: I have updated the hardware based recommendations with more focus on quality. I do not recommend q4_0 KV cache anymore beyond 64k context. After multiple rounds of testing with the different size quants,…
services with actually generous free tiers for open-source projects. my list, what would you add?
Been in the weeds shipping an OSS side project for the past few weeks (social media publishing API). Real launch post is coming, this isn't that. Along the way I kept a list of services that actually have usable free tie…
My local LLM is the best productivity tool I've installed in years, and it costs nothing to run
…It actually fits into my setup Integrations are simple Using a local LLM on its own is all good and well if it’s just for the purposes of extracting information. But…
AMD Making It Easier To Embed Lemonade AI Capabilities Into Other Apps
The open-source Lemonade local AI server that enables using Ryzen AI NPUs on Linux for LLM usage as well as AMD Radeon GPU support and common x86_64 CPU support (in…
Take-Two's CEO says AI's not in the business of making hits, 'datasets by their very nature are backward looking', but that doesn't mean AI can't be 'super helpful'
…favorites 3 Best graphics cards in 2026: These are the GPUs worth spending money in right now 4 Best gaming laptop 2026: I've tested the best laptops for gaming of this…