Pith

Pith is a proxy tool that optimizes large language model (LLM) usage by reducing output token consumption without losing information content. It evaluates cheaper output profiles by replaying and judging responses to ensure quality, refusing changes if content loss is detected. It can be deployed as a standalone proxy, or integrated with LiteLLM, Headroom, and Portkey tools to manage token costs compliantly.