Run DiffusionGemma on NVIDIA for Developer-Ready, High-Throughput Text Generation | NVIDIA Technical Blog
… Start the NIM server. $ export NIM IMAGE PATH = “nvcr.io/nim/google/diffusiongemma-26b-a4b-it:latest” $ docker run --gpus=all \ -e NGC API KEY=$NGC API KEY \ -v "$LOCAL NIM CACHE:/opt/nim/.cache" \ -p 8000:8000 \ ${NIM IMAGE PATH} Make a test request and read the full NIM documentation . from opena… …