Jevcrawl

Jevcrawl is a command-line interface and server that crawls websites directed at AI agents, optimizing the process of finding relevant answer pages. It leverages a small decision model to select links and passages to read, significantly reducing token usage, speeding up crawling, and decreasing costs compared to other methods like using Claude or Crawl4AI. It outputs verbatim passages with source metadata and integrates with MCP-compatible clients like Claude Code and Cursor.