Gateway Implementations¶
This project has several conformant Gateway implementations:
Agentgateway supports both standalone and Kubernetes deployment modes.
Gateway conformance status is governed by the Conformance Report Deprecation Policy. Implementations that have not submitted a successful Gateway profile report for the current minor release or either of the two previous minor releases may be removed from conformant implementation listings until they submit an accepted report.
Istio¶
Istio is an open source service mesh and gateway implementation. It provides a fully compliant implementation of the Kubernetes Gateway API for cluster ingress traffic control. For service mesh users, Istio also fully supports east-west (including GAMMA) traffic management within the mesh.
Gateway API Inference Extension support is being tracked by this GitHub Issue.
Agentgateway¶
Agentgateway is a high-performance, Rust-based AI gateway for LLM, MCP, and A2A workloads that can also serve as a Gateway API and Inference Gateway implementation.
It can run as a standalone binary or in Docker on a local machine or server without Kubernetes, or be deployed on Kubernetes for cluster-based environments, or within your llm-d infrastructure to improve accelerator (GPU) utilization for AI inference workloads.
NGINX Gateway Fabric¶
NGINX Gateway Fabric is an open-source project that provides an implementation of the Gateway API using NGINX as the data plane. The goal of this project is to implement the core Gateway API to configure an HTTP or TCP/UDP load balancer, reverse-proxy, or API gateway for applications running on Kubernetes. You can find the comprehensive NGINX Gateway Fabric user documentation on the NGINX Documentation website.