…This post explains model pruning and knowledge distillation, how they work, and how you can easily apply them to your own models to achieve optimal performance using NVIDIA TensorRT Model Optimizer . What…
NVIDIA Nsight Systems NVIDIA Nsight™ Systems is a system-wide performance analysis tool designed to visualize an application’s algorithms, identify the largest opportunities to optimize, and tune to scale efficiently across…
…Her main focus areas are AI infrastructure resilience and performance optimization. Prior to NVIDIA, Gargi worked at Meta in the Core Infra serving large scale distributed systems. She has expertise in Software…
…Learn more As AI agents move from the digital world to the physical environment, they can readily use NVIDIA Jetson to accelerate real-world deployment with optimized memory and performance. NVIDIA JetPack…
…Substantial performance improvements were realized through continuous co-optimization of hardware and open-source software, notably with advancements in NVIDIA TensorRT-LLM and Dynamo frameworks; techniques such as kernel fusion, optimized attention…
…The following steps outline how to set up and use the NVIDIA cuOpt supply chain agent reference workflow , which uses cuOpt agent skills to perform GPU-accelerated supply chain optimization using agent…
…He started his career at NVIDIA as a design engineer and later led a global engineering team that optimized the performance and power of high-speed IOs in NVIDIA GPUs and SoCs…
…iterations Optimized execution scheduling by the CUDA runtime Seamless composition with other graph-captured operations This composability is crucial for production training frameworks that rely on CUDA Graphs for performance optimization. Integrating…
…It provides “oracle” evaluation for new hardware by estimating performance ceilings and identifying bottlenecks using theoretical specs. HiSim also aids HiCache architecture exploration and cost/performance optimization through three-level KV cache…
…NVIDIA TensorRT™ and TensorRT LLM High-performance deep learning inference optimizer and runtime for production deployment. CUTLASS Modular C++ templates and Python DSLs for building high-performance kernels targeting NVIDIA Tensor Cores…