mcpField
F
firecrawl-map

firecrawl-map

Official
firecrawlAgent workflows67480.4k installsUpdated 1d ago
Repository

About firecrawl-map

firecrawl map is a skill in the Firecrawl CLI for discovering URLs on a website. It can search large sites for a specific page, and is useful for choosing target URLs before scraping or crawling. Authentication is required.

Key features

  1. 01Discovers URLs across a website
  2. 02Filters results with a search keyword
  3. 03Limits the number of returned URLs
  4. 04Outputs results as JSON or text
  5. 05Supports sitemap and subdomain options

Use cases

  1. 01Locating a specific page in a large documentation site
  2. 02Selecting URLs before scraping or crawling
  3. 03Saving a site URL inventory for later processing

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/firecrawl/cli --skill firecrawl-map

After installing, type/firecrawl-mapin Claude Code to confirm it loaded.

Details

From the project README

firecrawl map

Discover URLs on a site. Use --search to find a specific page within a large site.

Prerequisite: map requires authentication (no keyless free tier); without credentials the CLI prompts an interactive login.

Quick start

# Find a specific page on a large site
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt

# Get all URLs
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json

Run firecrawl map --help for the full option list (sitemap handling, subdomains, etc.).

Done when: the URL list is saved under .firecrawl/ and you have selected the URLs to scrape or crawl next.

Tips

  • Map + scrape is a common pattern: use map --search to find the right URL, then scrape it.
  • Example: map https://docs.example.com --search "auth" → found /docs/api/authentication → scrape that URL.

See also

Comments

Markdown supported