About CrawlKit Scrapers
CrawlKit Scrapers is a collection of Apify-based scrapers for data from commerce, travel, property, jobs, social media, reviews, finance, and search sites. It is intended for developers and AI agents, with examples using the Apify REST API and access through the Apify MCP server.
Key features
- 0124 Apify scraper Actors
- 02Scrapers across multiple data categories
- 03Per-result pricing
- 04Python examples using httpx
- 05Apify REST API access
- 06Apify MCP server integration
Use cases
- 01Collect hotel search results from Booking.com
- 02Retrieve product reviews from Amazon
- 03Extract YouTube transcripts
- 04Gather Zillow property listings
MCP support
CrawlKit Actors can be called by AI agents through the Apify MCP server at `https://mcp.apify.com`. The README points to tutorials for connecting clients such as Claude and Cursor.
Configuration
Remote servers need no local install. Pick your client, then copy the config or install in one click.
Endpoint
https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serpCopy install command
Claude CodeTerminal
claude mcp add --transport http crawlkit560-crawlkit-scrapers https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serpCursor.cursor/mcp.json
{"mcpServers":{"crawlkit560-crawlkit-scrapers":{"type":"http","url":"https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp"}}}Open in CursorVS Code.vscode/mcp.json
{"servers":{"crawlkit560-crawlkit-scrapers":{"type":"http","url":"https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp"}}}Open in VS CodeClaude Desktopclaude_desktop_config.json
{"mcpServers":{"crawlkit560-crawlkit-scrapers":{"type":"http","url":"https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp"}}}Windsurf~/.codeium/windsurf/mcp_config.json
{"mcpServers":{"crawlkit560-crawlkit-scrapers":{"serverUrl":"https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp"}}}Run commands in a terminal; paste JSON into the client’s MCP config and restart. Servers that need sign-in will prompt on first connect.
All endpoints
Streamable HTTP
https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serpAuth requiredTools
Details
From the project READMECrawlKit Scrapers
24 production scrapers for e-commerce, travel, real estate, jobs, social media, finance and more. All Actors run on Apify — no infrastructure to manage, pay per result.
Quick Start
pip install httpx
export APIFY_TOKEN="your_api_token_here"
python examples/booking.py
Get your API token at console.apify.com/account#/integrations.
Actors
E-commerce
| Actor | Price/result | Description |
|---|---|---|
| AliExpress Scraper | $0.0063 | Product search: title, price, discount, rating, store |
| Amazon Reviews Scraper | $0.0042 | Product reviews: rating, text, date, verified — 9 marketplaces |
| Google Shopping Scraper | $0.0024 | Shopping results: prices, sellers, ratings — 12 countries |
| Shopify Scraper | $0.0007 | Store products: prices, variants, stock, images, tags |
| Walmart Scraper | $0.0031 | Product search/pages: price, rating, seller, availability |
Travel
| Actor | Price/result | Description |
|---|---|---|
| Airbnb Scraper | $0.0028 | Search results: listing, price, rating, reviews, room type |
| Booking.com Scraper | $0.0035 | Hotel search: name, price, rating, stars, district, coordinates |
| Google Flights Scraper | $0.00017 | Flight fares: price, airline, times, duration, stops |
Real Estate
| Actor | Price/result | Description |
|---|---|---|
| Realtor.com Scraper | $0.0007 | Property listings: price, beds, baths, sqft, coordinates |
| Zillow Scraper | $0.0016 | Listings: price, Zestimate, beds, baths, sqft |
Jobs
| Actor | Price/result | Description |
|---|---|---|
| Google Jobs Scraper | $0.0063 | Job listings: title, company, location, salary, apply links |
| Indeed Jobs Scraper | $0.0005 | Job listings: title, company, salary — 6 countries |
| Glassdoor Scraper | $0.0023 | Company reviews + salary ranges by title |
Social Media
| Actor | Price/result | Description |
|---|---|---|
| Reddit Scraper | $0.0028 | Subreddit posts/comments: title, text, author, date |
| Telegram Channel Scraper | $0.0035 | Public channel messages: text, dates, views, media |
| YouTube Transcript Scraper | $0.0035 | Video transcripts with timestamps + metadata + comments |
Reviews
| Actor | Price/result | Description |
|---|---|---|
| App Store Reviews Scraper | $0.00007 | iOS + Google Play reviews: text, rating, date, app version |
| Trustpilot Reviews Scraper | $0.00048 | Reviews + company TrustScore, review count |
| Yelp Scraper | $0.0035 | Business reviews: name, address, rating, review text |
Finance
| Actor | Price/result | Description |
|---|---|---|
| SEC EDGAR & Yahoo Finance | $0.00035 | SEC filings (10-K, 10-Q, 8-K) + stock quotes + financials |
Search & Tech
| Actor | Price/result | Description |
|---|---|---|
| Bing & DuckDuckGo SERP | $0.0031 | Search results: titles, URLs, snippets, positions |
| Google News Scraper | $0.0028 | News articles: headlines, sources, dates, URLs |
| Google Trends Scraper | $0.0021 | Interest over time + related queries, up to 5 keywords |
| Tech Stack Detector | $0.0016 | Website tech stack: CMS, frameworks, analytics, CDN, hosting |
MCP Integration
All CrawlKit Actors are available through the Apify MCP server, making them callable by AI agents (Claude, Cursor, etc.) with zero code.
Endpoint: https://mcp.apify.com
See tutorials/mcp_integration.md for setup instructions.
Examples
| File | What it does |
|---|---|
| booking.py | Scrape hotels in Paris from Booking.com |
| amazon_reviews.py | Fetch product reviews from Amazon |
| youtube.py | Extract a video transcript from YouTube |
| google_trends.py | Get interest-over-time data for keywords |
| zillow.py | Scrape real estate listings from Zillow |
All examples use httpx + the Apify REST API. No SDK required.
Tutorials
- Getting Started — API token, first run, reading results
- MCP Integration — Connect CrawlKit to Claude, Cursor and other AI agents
- Pricing — Pay-per-result model, tiers, volume discounts
License
MIT
Comments
Markdown supported
New to MCP?
From what the protocol is to installing your first server, these answers cover most first questions.
An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.