VernLLM

VernLLM is a TypeScript framework that wraps existing large language model clients to add retries, circuit breaking, provider fallback, rate limiting, and caching. It improves the reliability of LLM calls by handling common failure modes in-process, without adding extra network hops. It supports many LLM providers and is zero-runtime dependencies.