whereismyai
CrawlForge MCP
CrawlForge MCP is an MCP server providing 31 web scraping tools to turn any website into clean markdown or JSON for AI agents.
CrawlForge MCP is an MCP server with 31 specialized web scraping tools designed to turn websites into clean markdown or structured JSON for AI agents. It plugs straight into AI clients like Claude, Cursor, or LangChain with a single configuration entry. The server handles tasks ranging from simple text and link extraction to stealth browsing, deep crawling, document processing, and autonomous AI research using local Ollama models or custom schemas. It suits developers and teams building AI agent pipelines, monitoring e-commerce prices, conducting SEO audits, or gathering competitive intelligence. Users start with a free tier of 1,000 credits and can scale through hobby, professional, and business yearly plans.
CrawlForge MCP at a glance
- Best for: Software engineer
- Runs on: API, self-hosted
- Pricing: Free plan with 1,000 credits; Hobby $190/year; Professional $990/year; Business $3,990/year
- Released: October 2026
- Category: AI coding tool
- Website: crawlforge.dev
Key features
- Extract and categorize all links from a page
- Pull title, description, OG tags, and structured data
- Extract clean plain text from web pages
- Fetch raw HTML or rendered content from any URL
- Process PDFs, DOCs, and other document formats
- Search the live web and get ranked results as JSON
- Render behind anti-bot walls in a real browser
- Process hundreds of URLs in parallel
Use it for
- Feed live web data into AI agent pipelines
- Track competitor prices and product availability
- Audit sites and competitors for SEO and metadata
- Gather competitor intelligence with stealth browsing
Alternatives to CrawlForge MCP
- CrawlRaven MCP — It provides typed Search Console and GA4 data directly inside AI chats.
- Scrapling — It uses adaptive element tracking to maintain scrapers when websites change.
- Apify MCP Server — Connects AI agents with over 79,000 web scraping and automation tools.
- MCP Market — Finds MCP servers that connect Claude and Cursor to developer tools.
- Jevcrawl — Finds answer pages more often and cheaper than letting Claude crawl.
- GitHub MCP Server — Connects AI tools directly to GitHub for natural language code management.
- JS Reverse MCP — It organizes scripts, breakpoints, and network data for continuous AI agent reasoning.
- jCodeMunch MCP — Cuts AI code-reading token costs by over 95 percent via tree-sitter symbol indexing.
- Pay-per-Crawl — Monetize AI crawlers with direct USDC payments on Base with zero platform custody.
- Magic MCP — Provides AI agents direct access to a catalog of 12,000+ React components.
- ContextMCP — Maintains fresh, accurate context for AI agents using AST-aware chunking.
- Coding Tools MCP — Turns any chat app into a coding agent with strict workspace safety boundaries.
All CrawlForge MCP alternatives