Search

Showing top 112 results for "Networking and AI announcements"

People also ask

What is an AI Gateway?

In a Kubernetes context, an AI Gateway refers to network gateway infrastructure (including proxy servers, load-balancers, etc.) that generally implements the Gateway API specification with enhanced capabilities for AI workloads. Rather than defining a distinct product category, AI Gateways describe infrastructure designed to enforce policy on AI traffic, including: Token-based rate limiting for AI APIs.Fine-grained access controls for inference APIs.Payload inspection enabling intelligent routing, caching, and guardrails.Support for AI-specific protocols and routing patterns.

Announcing the AI Gateway Working Group

Discussions and forums