About Crawlkit
CrawlKit is a platform for getting clean, structured data from the live web without running fetchers, browsers or background jobs yourself. Its API covers search, scraping a page into Markdown, HTML, text, metadata, links or screenshots, extraction into schema-validated JSON, site crawling, and a watch feature that tracks meaningful changes.
It also supports an MCP interface so AI agents can use web access, and the same platform offers a customer-discovery workflow that surfaces companies likely to need what you sell, based on signals such as product fit and hiring activity. Social and app store sources are included in the data it can pull.
CrawlKit is a hosted commercial service that uses a single credit balance. New accounts get 100 free credits, scraping a page costs one credit, and credits do not expire.
Key features
- Search and scrape pages into clean Markdown
- Schema-validated JSON extraction
- Site crawling with page limits and URL filters
- Watch pages for meaningful changes
- MCP access for AI agents
- Prospect discovery from web signals
Good fit for
- →Feeding live web data to AI agents
- →Finding companies that match a target customer profile
- Tags
- web-crawling
- api
- scraping
- mcp
- data-extraction
- lead-discovery
- monitoring
Crawlkit: questions and answers
- What is Crawlkit used for?
- Crawlkit is a web data API for searching, scraping, extracting, crawling and monitoring the live web, with an option to find prospect companies. It is a good fit for feeding live web data to AI agents and finding companies that match a target customer profile.
- Is Crawlkit free?
- Yes. Crawlkit has a free plan. Credit-based: 100 free credits to start, 1 credit per page scraped, and credits never expire.
- Is Crawlkit open source?
- No. Crawlkit is proprietary (closed-source) software and can't be self-hosted. In the API Tools category, open-source options include Nango, Kong and Tyk.
- What are some alternatives to Crawlkit?
- Crawlkit competes with ScrapingBee, ScraperAPI and ZenRows.
Open-source alternatives to Crawlkit
See all
Nango
API Tools
Connect your agents & product to 1,000 APIs.
OSSvs Merge★ 12k
Kong
API Tools
🦍 The API and AI Gateway
Apache-2.0vs Apigee★ 44k
Tyk
API Tools
Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context
OSSvs Apigee★ 11k
Higress
API Tools
🤖 AI Gateway | AI Native API Gateway
Apache-2.0vs Amazon API Gateway★ 9.5k
CodeChat
API Tools
CodeChat - WhatsApp Api
Apache-2.0vs Twilio★ 1.3k
Orange API Gateway
API Tools
OpenResty/Nginx Gateway for API Monitoring and Management.
MITvs Apigee★ 2.3k
SaaS alternatives to Crawlkit
See all
ScrapingBee
API Tools
Web scraping API that handles headless browsers and proxy rotation
SaaS
ScraperAPI
API Tools
Web scraping API with proxy rotation, CAPTCHA handling and JavaScript rendering
SaaS
ZenRows
API Tools
Web scraping API with anti-bot bypass and headless browser rendering
SaaS
Bright Data
API Tools
Web data platform with proxy networks, scraping APIs and datasets
SaaS
Apify
Workflow Automation
Cloud platform and marketplace for web scraping and browser automation actors
SaaS
CreatorCrawl
API Tools
Social media data API and MCP server that gives AI agents live data from TikTok, Instagram, YouTube and more
SaaS

