In addition to Muon, NVIDIA also supports many other optimizers for the research community to explore, including: The ultimate form of orthogonalized optimizer MOP (Momentum Orthogonalized by Polar decomposition) An advanced SOAP variant that updates eigen basis per step with eigen decomposition plus KL correction in REKLS
Advancing Emerging Optimizers for Accelerated LLM Training with NVIDIA Megatron | NVIDIA Technical Blog…workflows, primarily using the community library. While effective for simple documents, this approach struggled with complex layouts and dense semantic relationships, limiting both throughput and extraction accuracy. Supporting modern deep learning–based…
…Synthetic Data Generation Use Cases Omniverse Replicator Getting Started Guide More Resources Join the Community Sign Up for the Developer Newsletter Join the NVIDIA Developer Program Ethical AI NVIDIA believes Trustworthy AI…
…The control plane now supports robust multi-organization isolation via virtualization, logical network segmentation (VXLAN for Spectrum-X Ethernet, PKeys for Quantum InfiniBand), and dedicated compute and management resources per organization, reducing…
…Centralized Control Plane Deploy and orchestrate multi-stage workloads on Kubernetes clusters supporting x86, Arm, and NVIDIA GPUs. These workloads are deployable on-premises and on major Cloud Service Providers (CSP). Infrastructure…
Aerial Developer Forum Have questions about NVIDIA AI Aerial or tips and tricks to share? Join the community on the Aerial Developer Forum. Click the link above to access. NVIDIA AI Aerial…
…NVIDIA Nemotron™ powers RAG through open models for state‑of‑the‑art extraction, embedding, and reranking, enabling secure, scalable retrieval and supported by open datasets and training tools. These technologies power the…
…Modular and Componentized APIs With a component-level design and modular structure, cuEST APIs are fully composable , giving independent software vendors (ISVs), open source projects, and communities the flexibility to integrate NVIDIA…
…Source code and community contributions. NVIDIA DGX Spark : Hardware specifications and developer resources. Prerequisites For full setup instructions, visit the DGX Spark Playbook for NemoClaw , or get started with no hardware needed…
…A practical federated computing platform needs to support: No data copy: Data stays local, and only model updates (or equivalent signals) move. Compliance posture: Deployment and governance controls that support sovereignty and…
Networking / Communications Introducing NVIDIA BlueField-4-Powered CMX Context Memory Storage Platform for the Next Frontier of AI Mar 16, 2026 By Moshe Anschel , Einav Zilberstein , Oren Duer , Kirill Shoikhet and Ronil…