About Outcrawl
Outcrawl is a hosted web infrastructure MCP server for AI agents, covering scraping, search, site crawling, change monitoring, and tasks in a real browser. It suits agents reading pages or handling logins and multi-step flows, with browser OAuth sign-in and usage charged to a chosen workspace’s credits.
Key features
- 01Extract pages as Markdown or JSON
- 02Search the web and read results
- 03Crawl a site from a seed URL
- 04Run multi-step tasks in a real browser
- 05Monitor pages for changes
- 06Manage browser profiles and session records
Use cases
- 01Extract content from a known page
- 02Search and summarize web sources
- 03Organize pages across site documentation
- 04Track updates and send notifications
MCP support
The hosted Streamable HTTP MCP server connects to clients through OAuth or an API key and exposes scraping, search, crawling, browser-agent, monitoring, session, and usage tools. Calls consume credits from the selected workspace, and results report their cost.
Configuration
Remote servers need no local install. Pick your client, then copy the config or install in one click.
https://api.outcrawl.ai/mcpclaude mcp add --transport http outcrawlai-outcrawl https://api.outcrawl.ai/mcp{"mcpServers":{"outcrawlai-outcrawl":{"type":"http","url":"https://api.outcrawl.ai/mcp"}}}Open in Cursor{"servers":{"outcrawlai-outcrawl":{"type":"http","url":"https://api.outcrawl.ai/mcp"}}}Open in VS Code{"mcpServers":{"outcrawlai-outcrawl":{"type":"http","url":"https://api.outcrawl.ai/mcp"}}}{"mcpServers":{"outcrawlai-outcrawl":{"serverUrl":"https://api.outcrawl.ai/mcp"}}}Run commands in a terminal; paste JSON into the client’s MCP config and restart. Servers that need sign-in will prompt on first connect.
Tools
Details
From the project README
Outcrawl MCP
Give your AI agent the web. Outcrawl is web infrastructure for AI agents: connect it once, then ask in plain words. Your agent reads any page as clean markdown or JSON, crawls a whole site, searches the web with the results already read, watches pages for changes, and hands a multi-step task (a login, a form, a flow across pages) to an agent working in a real browser.
- Server:
https://api.outcrawl.ai/mcp(streamable HTTP) - Sign-in: OAuth in your browser on first use. No key to copy, nothing to paste into a config file.
- 30 tools: scrape, crawl, search, agent runs, monitors, profiles, recorded sessions, usage, credits and workspace rules. Tool reference
The server is hosted by Outcrawl. There is no local package to install or run. You pick one workspace when you sign in, every call spends that workspace's credits, and every result reports what it cost. The Free plan has 1,000 credits a month; a page load is 1 credit. Pricing
Connect your agent
Claude Code
claude mcp add --transport http outcrawl https://api.outcrawl.ai/mcp
The first tool call opens a browser to sign in and pick a workspace.
Or install the plugin, which adds the server and a skill that teaches Claude which tool to reach for:
/plugin marketplace add outcrawlai/outcrawl-mcp
/plugin install outcrawl@outcrawl
Cursor
Or add it in Cursor's MCP settings (~/.cursor/mcp.json):
{ "mcpServers": { "outcrawl": { "url": "https://api.outcrawl.ai/mcp" } } }
Codex
codex mcp add outcrawl --url https://api.outcrawl.ai/mcp
codex mcp login outcrawl
Or in ~/.codex/config.toml:
[mcp_servers.outcrawl]
url = "https://api.outcrawl.ai/mcp"
Gemini CLI
gemini extensions install https://github.com/outcrawlai/outcrawl-mcp
Any other MCP client
Give the client the URL https://api.outcrawl.ai/mcp and choose OAuth. It registers itself and signs you in through your browser on first use:
{ "mcpServers": { "outcrawl": { "url": "https://api.outcrawl.ai/mcp" } } }
A client with no OAuth support
Create an API key in the console at https://outcrawl.ai/console/keys and send it as a header:
{
"mcpServers": {
"outcrawl": {
"url": "https://api.outcrawl.ai/mcp",
"headers": { "Authorization": "Bearer ock_YOUR_KEY_ID.YOUR_SECRET" }
}
}
}
This is the one place an API key belongs in an MCP config; every client above signs in instead.
Tools
| Group | Tools | What they do |
|---|---|---|
| Read the web | outcrawl_scrape, outcrawl_crawl, outcrawl_search | One known URL to markdown, HTML, links, a screenshot or JSON; a whole site from a seed URL; a web search with every hit read in full |
| Agents | outcrawl_agent and 9 more | Give a task to an agent in a real browser under caps you set, follow its steps, read its records as they land, cancel it, hand its browser to a person, pass it a file, list its downloads |
| Monitors | outcrawl_monitor_create, outcrawl_monitor_list, outcrawl_monitor_delete | Watch a URL on a schedule and notify Discord, Slack or a webhook when it really changes |
| Profiles | outcrawl_profile_create, outcrawl_profile_list, outcrawl_profile_get, outcrawl_profile_delete | Keep cookies and site storage so a login survives across runs, optionally pinned to a country, region and city |
| Sessions | outcrawl_sessions_list, outcrawl_sessions_get, outcrawl_session_network, outcrawl_session_request, outcrawl_session_downloads, outcrawl_session_delete | Every session is recorded: its replay URL, network and console digest, any request in full, its downloads |
| Account | outcrawl_usage, outcrawl_credits, outcrawl_rules_get, outcrawl_rules_set | Usage over a date range, the credit pool, and workspace rules written in plain sentences |
Pick the cheapest tool that answers: a scrape to read a page you know, a search to find pages, a crawl to cover a site, and an agent only when the answer is behind a login, a form or a multi-step flow. An agent run costs far more than a scrape for the same text.
Try it
Read https://outcrawl.ai/pricing and list the plans with their prices.
Search for the latest Model Context Protocol changes and summarize the top three.
Crawl the docs at https://outcrawl.ai/docs, at most 20 pages, and list the page titles.
Watch https://example.com/changelog every hour and post to my Slack webhook when it changes.
What is in this repo
| File | For |
|---|---|
.claude-plugin/ and .mcp.json | Claude Code plugin and marketplace |
plugin.json and mcp.json | Agent Plugins package (Cursor, ChatGPT, Codex) |
.cursor-plugin/plugin.json | Cursor Marketplace |
gemini-extension.json | Gemini CLI extension |
server.json | The official MCP registry entry, io.github.outcrawlai/outcrawl |
skills/outcrawl/SKILL.md | The skill every package ships: which tool answers which question, and how to keep spend down |
This repo only packages the connection; the server is hosted by Outcrawl.
Links
- Docs: https://outcrawl.ai/docs/mcp/setup
- Product: https://outcrawl.ai/?utm_source=github&utm_medium=directory&utm_campaign=mcp
- Support: [email protected]
- Privacy: https://outcrawl.ai/legal/privacy
- Terms: https://outcrawl.ai/legal/terms
MIT licensed.
Comments
New to MCP?
From what the protocol is to installing your first server, these answers cover most first questions.
An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.