…13 MIN READ Feb 09, 2026 Automating Inference Optimizations with NVIDIA TensorRT LLM AutoDeploy NVIDIA TensorRT LLM enables developers to build high-performance inference engines for large language models (LLMs), but deploying…
…NVIDIA researchers and engineers have demonstrated a method that combines structured weight pruning with knowledge distillation, a powerful strategy for compressing large models into smaller, efficient variants without significant loss in quality…
…A developer’s guide to open source LLMs and generative AI Open source generative AI projects are a great way to build new AI-powered features and apps. The world's largest…
…AI Agent | Build AI Agents | featured | LLMs | Retrieval Augmented Generation (RAG) | Trustworthy AI About the Authors About Edward Li Edward Li is a technical marketing engineer with NVIDIA Enterprise Computing. He is…
…the boundaries of LLM training efficiency. Through layerwise distributed optimization, tailored distributed Newton-Schulz iterations, and ongoing work on communication hiding and fused SYRK/all-reduce kernels, these powerful methods can now…
Engineering at Anthropic Building effective agents Over the past year, we've worked with dozens of teams building large language model (LLM) agents across industries. Consistently, the most successful implementations weren't…
…But if your local AI only lives in a chat box, you’ve essentially built a high-powered engine just to idle in the driveway. Relying on manual prompting is a massive…
…friction back in,” said Lavigne, using the engineering term frequently used by tech bros to describe inefficiencies in a system. He argues that LLM chatbots have taken this idea of “friction” to…
…With the right tweaks, I’ve even managed to run powerful LLMs that can rival their cloud-based counterparts on something as outdated as a 10-year-old rig . That said, most…
…LLM | Intermediate Technical | Benchmark | Tutorial | AI Inference | featured | Inference Performance | LLMs | NVFP4 | Retrieval Augmented Generation (RAG) | STAC About the Authors About Dan Blanaru Dan Blanaru is an AI developer technology engineer at…