In addition to Muon, NVIDIA also supports many other optimizers for the research community to explore, including: The ultimate form of orthogonalized optimizer MOP (Momentum Orthogonalized by Polar decomposition) An advanced SOAP variant that updates eigen basis per step with eigen decomposition plus KL correction in REKLS
Advancing Emerging Optimizers for Accelerated LLM Training with NVIDIA Megatron | NVIDIA Technical Blog…She works with key partners and foundations to enable NVIDIA accelerated platform support for the open source developer ecosystem. Prior to NVIDIA, she worked at Google for over a decade in various…
…time, studios can provision high-performance virtual environments for geographically distributed teams, improving infrastructure consistency and making it easier to support parallel development across locations. This virtualized model is designed to help…
…Learn more Agentic code assistants are moving into daily game development as studios build larger worlds, ship more DLCs, and support distributed teams. These assistants can accelerate development by helping with tasks…
…ACCESS NVIDIA owns and operates the Sites and owns or distributes additional Technology at its choice. NVIDIA may change, discontinue, or deprecate any part, or all, of the Technology or change, add…
…that lets you easily scale your workloads across distributed environments—from on-premises to private and public cloud resource clusters. Developer Resources and Support Explore the Community Get Training and Certification Join…
…Rather than being tied to a single scene format, it supports a broad runtime data model that spans common robotics descriptions such as MJCF, URDF, and OpenUSD, making it easier to connect…
…It will support Jetson Orin series 2026 JetPack 6 is in sustaining mode. It supports Jetson Orin with production-ready feature releases. It also supports Jetson Platform Services, Upgradable AI compute stack…
…As organizations deploy agentic AI systems capable of reasoning, automation, and real-time decision-making at scale, competitive advantage increasingly depends on the infrastructure that supports them. Success requires more than raw…
…To resolve this, Spectrum-X Ethernet’s Advanced Adaptive Routing distributes traffic packet-by-packet across all available paths according to real-time link load, sustaining effective bandwidth near the fabric’s…
…Individual agents can be powerful on their own, but coordinated groups of agents can accomplish far more, much like human societies scale their capability through collective intelligence and coordination. Supporting these emerging…