mcpField
F
firecrawl-scrape

firecrawl-scrape

github.com/parcadeiData & databases3.9k492 installsUpdated 39w ago
Repository

About firecrawl-scrape

A skill for scraping web pages, extracting structured content, and searching the web through a Firecrawl server. It is intended for workflows that need page content in Markdown, HTML, or text form.

Key features

  1. 01Scrape a URL
  2. 02Extract page content
  3. 03Search the web
  4. 04Choose Markdown, HTML, or text output

Use cases

  1. 01Collect content from a documentation page
  2. 02Retrieve text from a web page
  3. 03Search for a topic and scrape results

MCP support

Requires a configured `firecrawl` MCP server and `FIRECRAWL_API_KEY` to run the scrape script.

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/parcadei/continuous-claude-v3 --skill firecrawl-scrape

After installing, type/firecrawl-scrapein Claude Code to confirm it loaded.

Details

From the project README

Firecrawl Scrape Skill

When to Use

  • Scrape content from any URL
  • Extract structured data from web pages
  • Search the web and get content

Instructions

uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
    --url "https://example.com" \
    --format "markdown"
Parameters
  • --url: URL to scrape
  • --format: Output format - markdown, html, text (default: markdown)
  • --search: (alternative) Search query instead of direct URL
Examples
# Scrape a page
uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
    --url "https://docs.python.org/3/library/asyncio.html"

# Search and scrape
uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
    --search "Python asyncio best practices 2024"

MCP Server Required

Requires firecrawl server in mcp_config.json with FIRECRAWL_API_KEY.

Comments

Markdown supported