mcpField
F
firecrawl-map

firecrawl-map

github.com/firecrawlProductivity252103 installsUpdated 6d ago
Repository

About firecrawl-map

firecrawl-map is a Firecrawl CLI skill that discovers URLs on a website and saves the URL list. Search terms can narrow results on large sites, and the discovered URLs can then be scraped or crawled.

Key features

  1. 01Discover URLs on a site
  2. 02Search within large sites
  3. 03Save URL lists as text or JSON
  4. 04Set a result limit
  5. 05Support sitemap and subdomain options

Use cases

  1. 01Find a specific page on a large site
  2. 02Collect URLs before scraping pages
  3. 03Prepare a URL list for crawling

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/firecrawl/firecrawl-claude-plugin --skill firecrawl-map

After installing, type/firecrawl-mapin Claude Code to confirm it loaded.

Details

From the project README

firecrawl map

Discover URLs on a site. Use --search to find a specific page within a large site.

Prerequisite: map requires authentication (no keyless free tier); without credentials the CLI prompts an interactive login.

Quick start

# Find a specific page on a large site
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt

# Get all URLs
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json

Run firecrawl map --help for the full option list (sitemap handling, subdomains, etc.).

Done when: the URL list is saved under .firecrawl/ and you have selected the URLs to scrape or crawl next.

Tips

  • Map + scrape is a common pattern: use map --search to find the right URL, then scrape it.
  • Example: map https://docs.example.com --search "auth" → found /docs/api/authentication → scrape that URL.

See also

Comments

Markdown supported