7,363 open-source and SaaS tools, with GitHub stats refreshed every day.

Crawlkit

SaaS

A web data API for searching, scraping, extracting, crawling and monitoring the live web, with an option to find prospect companies.

crawlkit.sh
Crawlkit homepage screenshot

About Crawlkit

CrawlKit is a platform for getting clean, structured data from the live web without running fetchers, browsers or background jobs yourself. Its API covers search, scraping a page into Markdown, HTML, text, metadata, links or screenshots, extraction into schema-validated JSON, site crawling, and a watch feature that tracks meaningful changes.

It also supports an MCP interface so AI agents can use web access, and the same platform offers a customer-discovery workflow that surfaces companies likely to need what you sell, based on signals such as product fit and hiring activity. Social and app store sources are included in the data it can pull.

CrawlKit is a hosted commercial service that uses a single credit balance. New accounts get 100 free credits, scraping a page costs one credit, and credits do not expire.

Key features

  • Search and scrape pages into clean Markdown
  • Schema-validated JSON extraction
  • Site crawling with page limits and URL filters
  • Watch pages for meaningful changes
  • MCP access for AI agents
  • Prospect discovery from web signals

Good fit for

  • →Feeding live web data to AI agents
  • →Finding companies that match a target customer profile
Tags
web-crawling
api
scraping
mcp
data-extraction
lead-discovery
monitoring

Crawlkit: questions and answers

What is Crawlkit used for?
Crawlkit is a web data API for searching, scraping, extracting, crawling and monitoring the live web, with an option to find prospect companies. It is a good fit for feeding live web data to AI agents and finding companies that match a target customer profile.
Is Crawlkit free?
Yes. Crawlkit has a free plan. Credit-based: 100 free credits to start, 1 credit per page scraped, and credits never expire.
Is Crawlkit open source?
No. Crawlkit is proprietary (closed-source) software and can't be self-hosted. In the API Tools category, open-source options include Nango, Kong and Tyk.
What are some alternatives to Crawlkit?
Crawlkit competes with ScrapingBee, ScraperAPI and ZenRows.

Open-source alternatives to Crawlkit

See all

SaaS alternatives to Crawlkit

See all