Relay

Relay is a self-hosted or hosted AI gateway that provides a unified OpenAI-compatible API to route, pace, queue, and monitor requests across numerous large language model providers and local models. It supports advanced routing, request classification, guardrails, cost and usage tracking, and real-time visibility, designed primarily for developers building AI agents and workflows with multiple LLM backends.