About web-scraper
A DataLeads web-scraping API for developers who need content from protected pages. It renders pages in a real browser, handles anti-bot measures, and returns JSON or Markdown.
Key features
- 01Fetch and browse pages
- 02Crawl websites
- 03Handle protected pages
- 04Return JSON or Markdown
- 05Captcha-solving endpoint
Use cases
- 01Extract content from protected pages
- 02Crawl website pages
- 03Convert webpages into processable formats
MCP support
Available as a remote Streamable HTTP MCP server or through Docker over Stdio. MCP clients can use its web-fetching and browsing endpoints.
Configuration
Remote servers need no local install. Pick your client, then copy the config or install in one click.
https://data.dataleads.pro/mcp/web-scraperclaude mcp add --transport http dataleadspro-web-scraper https://data.dataleads.pro/mcp/web-scraper{"mcpServers":{"dataleadspro-web-scraper":{"type":"http","url":"https://data.dataleads.pro/mcp/web-scraper"}}}Open in Cursor{"servers":{"dataleadspro-web-scraper":{"type":"http","url":"https://data.dataleads.pro/mcp/web-scraper"}}}Open in VS Code{"mcpServers":{"dataleadspro-web-scraper":{"type":"http","url":"https://data.dataleads.pro/mcp/web-scraper"}}}{"mcpServers":{"dataleadspro-web-scraper":{"serverUrl":"https://data.dataleads.pro/mcp/web-scraper"}}}Run commands in a terminal; paste JSON into the client’s MCP config and restart. Servers that need sign-in will prompt on first connect.
Tools
4| Parameter | Type | Required | Description |
|---|---|---|---|
| url | string | No | |
| maxTimeout | integer | No |
Details
From the project READMEWeb Scraper API (Anti-Bot)
Fetch, crawl, and browse protected pages with anti-bot handling - renders in a real browser and returns clean JSON or markdown.
Part of the DataLeads API suite (Data category). Requests render in a real browser with anti-bot handling and protected-page support built in - no proxies to manage, no infrastructure to run.
Endpoints
| Method | Path | Description |
|---|---|---|
| POST | /fetch | V1 Fetch |
| POST | /web/crawl | V1 Web Crawl |
| POST | /browse | V1 Browse |
| POST | /captcha/solve | V1 Captcha Solve |
Quick start
curl -X POST https://data.dataleads.pro/v1/fetch \
-H 'Content-Type: application/json' \
-d '{"clientKey": "YOUR_CLIENT_KEY", "url": "https://www.zillow.com/homes/Austin,-TX_rb/"}'
Replace YOUR_CLIENT_KEY with your key. Get one at https://data.dataleads.pro - free tier included.
MCP server
- Remote (Streamable HTTP):
https://data.dataleads.pro/mcp/web-scraper - Stdio (Docker):
docker run -e DATALEADS_API_KEY=yourkey ghcr.io/dataleads/web-scraper-mcp:latest
Pricing
| Tier | Price | Requests |
|---|---|---|
| Free | $0 | 500/mo |
| Starter | $9/mo | 5,000 |
| Pro | $29/mo | 25,000 |
| Business | $99/mo | 100,000 |
| Enterprise | custom | custom |
Full plan details at https://data.dataleads.pro.
License
MIT - see LICENSE.
Comments
New to MCP?
From what the protocol is to installing your first server, these answers cover most first questions.
An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.