mcpField
F
firecrawl-map

firecrawl-map

github.com/firecrawlProductivity1395.8k installsUpdated 6d ago
Repository

About firecrawl-map

A skill for using Firecrawl map to discover URLs on a website, with search filtering to locate specific pages on large sites. It supports selecting pages for a subsequent scrape or crawl.

Key features

  1. 01Discover site URLs
  2. 02Filter URL discovery with search
  3. 03Save URL lists as text or JSON

Use cases

  1. 01Locate an authentication page in documentation
  2. 02Select pages to scrape next
  3. 03Create a site URL inventory

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/firecrawl/skills --skill firecrawl-map

After installing, type/firecrawl-mapin Claude Code to confirm it loaded.

Details

From the project README

firecrawl map

Discover URLs on a site. Use --search to find a specific page within a large site.

Prerequisite: map requires authentication (no keyless free tier); without credentials the CLI prompts an interactive login.

Quick start

# Find a specific page on a large site
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt

# Get all URLs
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json

Run firecrawl map --help for the full option list (sitemap handling, subdomains, etc.).

Done when: the URL list is saved under .firecrawl/ and you have selected the URLs to scrape or crawl next.

Tips

  • Map + scrape is a common pattern: use map --search to find the right URL, then scrape it.
  • Example: map https://docs.example.com --search "auth" → found /docs/api/authentication → scrape that URL.

See also

Comments

Markdown supported