Python scraper based on AI

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown using remote browsers. Firecrawl alternative

Open‑source alternative to Perplexity Comet, director.ai and firecrawl combined

🕷️ A lightweight Model Context Protocol (MCP) server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents. Similar to Firecrawl's API but self-hosted and free. Perfect for integrating web scraping into your AI workflows with OpenAI Agents SDK, Cursor, Claude Code, and other MCP-compatible tools.

Fast, lightweight Firecrawl alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/v1/scrape, /v1/crawl, /v1/search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

AnyCrawl — Coolify v4 Template

The web data layer for AI agents — fetch, search, crawl, extract, screenshot, and monitor the web with 50+ domain extractors and MCP.

Firecrawl Skill: Scrape, Search, Crawl, Browse. Token-efficient scraping skill, optimized for Claude Code, Codex, Gemini.

🕷️ Enable AI agents to scrape and crawl the web effortlessly with this lightweight Model Context Protocol server, integrating seamlessly into your workflows.

🔍 Control browsers using natural language commands with multi-AI model support for seamless automation and task management.

Self-hosted web scraper — convert any URL to agent-friendly markdown/JSON. Anti-bot bypass + autonomous browser agents. Free alternative to Firecrawl.

Transform Web Content into LLM-Ready Data

🔥 The Web Scraping API That Doesn't Rip You Off — Turn any website into LLM-ready markdown. 10x cheaper than Firecrawl.

🧭 Enhance your browsing with Browser Pilot, an AI assistant that understands web content and automates complex tasks for a smarter online experience.

Free self-hosted Firecrawl alternative — Crawl4AI MCP plugin for Claude Code