NIXL is an open source library for accelerating point-to-point data transfers in AI inference frameworks. NIXL provides a single, easy-to-use API that can be used to address a variety of data transfer challenges within these frameworks while maintaining maximum performance. This API supports multiple technologies such as RDMA, GPU-initiated networking, GPU-Direct storage, block and file storage, and advanced cloud storage options including S3 over RDMA and Azure Blob Storage. It is vendor-agnostic and can run across diverse environments. For example, it supports Amazon Web Services (AWS) with
Enhancing Distributed Inference Performance with the NVIDIA Inference Transfer Library | NVIDIA Technical Blog… Discuss 0 Discuss 0 Tags Agentic AI / Generative AI | Developer Tools & Techniques | Gaming | ACE | Intermediate Technical | Tutorial | DLSS | featured | Game Performance | RTX AI | SLMs About the Authors About Brandon Rowlett Brandon Rowlett is a dev tech at NVIDIA, where he helps game developers … …
… Discuss 0 Discuss 0 Tags Developer Tools & Techniques | MLOps | Networking / Communications | HPC / Scientific Computing | Dynamo | NVLink | TensorRT-LLM | Intermediate Technical | Deep dive | Tutorial | AI Agent | AI Inference | Inference Performance | Python About the Authors About Seonghee Lee S… …
… Learn more NVIDIA CUDA Tile is a GPU-based programming model that targets portability for NVIDIA Tensor Cores, unlocking peak GPU performance. …
… Tech Blog CUDA Tile Programming in Python With cuTile Python cuTile Python Ready to unify GPU performance with Python's simplicity? …
… Diya has a bachelor of technology in electronics and communications engineering from the LNM Institute of Information Technology LNMIIT in India. View all posts by Diya Shah View all posts by Diya Shah About Rakesh Madugundu Rakesh is an ML performance engineer at Sarvam AI. …
… Step 1: Add the small molecule target Note that this step is not required for the SAM example because the target ligand has already been added. complexa target add sam \ --target-path /path/to/your/7C7M.pdb \ --ligand SAM \ --binder-length 100 \ --dict configs/targets/ligand targets dict.yaml Step … …
… View all posts by Anshuman Bhat View all posts by Anshuman Bhat About Aditya Sahu Aditya Sahu is a technical marketing engineer on the NVIDIA Jetson Edge AI Platform team. He is responsible for driving the adoption and showcasing the technical capabilities of the platform. …
… Discuss 0 Discuss 0 Tags Agentic AI / Generative AI | Data Science | Developer Tools & Techniques | General | cuDF | cuML | Intermediate Technical | Tutorial | featured | Kaggle | LLM Techniques About the Authors About Chris Deotte Chris Deotte is a senior data scientist at NVIDIA. …
… View all posts by Tianhao Xu View all posts by Tianhao Xu About Ben Hamm Ben Hamm is a technical product manager at NVIDIA, with a focus on LLM inference performance and optimization. …
… This well-optimized kernel specifically targets MoE models, boosting overall end-to-end performance. …