#795 · Primary category: AI Agents & Automation

donsetch

agpl ai-agents anti-bot crawling mcp pdf rust web-scraper web-search

Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.

Project last updated:08/30/26

GitHub Stars

516

Forks

33

Contributors

10

License

AGPL-3.0

Why we included this project

DonSeTch gives AI agents a way to pull live data from the web without the usual setup tax. It ships as a single Rust binary that speaks the Model Context Protocol, so MCP clients like Claude Code and Cursor can call its fetch, search, and crawl tools directly. There are no API keys and no accounts; you run the process and it goes. The part that stands out is the anti-bot handling: instead of faking a browser fingerprint, it drives Chrome's real TLS stack, and when a captcha or challenge page appears it can briefly switch to a headless browser, solve the puzzle, and hand clean cookies back to the fast path. That is genuinely useful for anyone whose agents keep getting 403s. The same binary also works as a plain CLI, so you can test a fetch or search before wiring it into a bigger workflow.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category