jev-align

jev-align is an experimental CLI tool that enables building and improving calibrated AI classifiers by incorporating human feedback through iterative labeling and model refinement. It works with datasets (CSV, Parquet, JSONL), finds uncertain examples for users to label, and uses GEPA to optimize AI functions based on this feedback. Supports multiple AI backend providers and task types including binary, multiclass, and scoring tasks.