Improving Ray Serve LLM on GKE throughput, latency | Google Cloud Blog
…We chose to run Gemma 4 E2B as a small, efficient model to isolate bottlenecks introduced from orchestration and routing. Our benchmarks compared the new Ray Serve LLM to its prior performance…
