AI Gateway Glossary: Key Terms for Enterprise AI Infrastructure Clear, neutral definitions of the core concepts in enterprise AI infrastructure — AI gateway, LLM gateway, inference gateway, MCP, AI guardrails, and more. Read more
How to Migrate from LiteLLM to an Enterprise AI Gateway (Step-by-Step) A practical, step-by-step guide to migrating from LiteLLM to an enterprise AI gateway without rewriting your agents. Read more
Is LiteLLM Safe to Use? What the 2026 Security Incidents Mean for Your AI Stack LiteLLM shipped malware twice in 2026 and had at least six CVEs. See which versions and Docker tags are affected and what to do now. Read more
LiteLLM vs Kong AI Gateway: Which Open Source Gateway Wins? LiteLLM vs Kong AI Gateway: LiteLLM routes 140+ providers through a Python proxy you run yourself, while Kong fits teams already running it for APIs. This evaluation covers open source scope, performance, failover, plugins, and operating cost. Read more
LiteLLM vs OpenRouter: Gateway vs Aggregator Explained LiteLLM is an open source gateway you deploy and run while OpenRouter is a hosted aggregator with 500+ models and a fee on credit purchases. Compare data path, cost, and operations, plus when teams move to an enterprise AI gateway such as Tetrate Agent Router Enterprise. Read more
What Is an AI Egress Gateway? An AI egress gateway is the control point for calls leaving your cluster for model providers and MCP servers. The gateway decides which destinations your agents can reach, adds provider keys on the way out, and counts tokens per team. Read more
What Is an AI Ingress Gateway? An AI ingress gateway is the entry point for requests coming into your AI agents and self-hosted models. The gateway checks who is calling and how many tokens the caller can spend before the request reaches your agent or your GPUs. Read more
AI Ingress vs. AI Egress: Two Directions of AI Traffic, One Control Point AI ingress controls requests coming into your agents and self-hosted models. AI egress controls calls leaving your cluster for models and MCP servers. One Envoy data plane can govern both directions. Read more
Gateway API Egress: What GEP-4488 Means for AI Traffic Gateway API has no stable egress API. GEP-4488 proposes a Backend resource for external destinations, and the GEP remains provisional. Your agents need egress control now. Read more