jevals

jevals is a Python library that provides efficient evaluation and monitoring of AI agent interactions by replacing costly LLM judges with typed Jev decision models. It performs multiple evaluation metrics in a single request with low latency and cost, supports various backends including self-hosted and local models, and is designed for use during development, production monitoring, and gating.