mcpField
T
tavily-map

tavily-map

github.com/tavily-aiProductivity49117.4k installsUpdated 8w ago
Repository

About tavily-map

tavily-map is a CLI skill for discovering URLs on a website without extracting page content. It helps research workflows locate relevant pages before extraction or crawling.

Key features

  1. 01Discover site URLs
  2. 02Filter with natural-language guidance
  3. 03Include or exclude paths and domains
  4. 04Limit depth, breadth, and URL count
  5. 05Return or save JSON

Use cases

  1. 01Find a specific page on a large site
  2. 02List URLs before choosing pages to extract
  3. 03Locate documentation with semantic filters

MCP support

This skill uses the `tvly` CLI; the input does not describe direct MCP connectivity.

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/tavily-ai/skills --skill tavily-map

After installing, type/tavily-mapin Claude Code to confirm it loaded.

Details

From the project README

tavily map

Discover URLs on a website without extracting content. Faster than crawling.

Before running

Map requires authentication. Run the requested command directly when tvly is already authenticated; do not add a status check to every invocation.

If tvly is missing, follow the tavily-cli setup. If an installed CLI reports an authentication error, use tvly login for authentication only, or tvly init --skip-skills when guided verification is also useful. Browser-based OAuth is preferred when an interactive user can complete it. --no-browser prints the sign-in link instead of opening it, but still waits for a localhost callback. In an unattended agent or CI environment, leave authentication to the user or use a securely provided TAVILY_API_KEY. Do not start a second login immediately after guided setup has completed.

When to use

  • You need to find a specific subpage on a large site
  • You want a list of all URLs before deciding what to extract or crawl
  • Step 3 in the workflow: search → extract → map → crawl → research

Quick start

# Discover all URLs
tvly map "https://docs.example.com" --json

# With natural language filtering
tvly map "https://docs.example.com" --instructions "Find API docs and guides" --json

# Filter by path
tvly map "https://example.com" --select-paths "/blog/.*" --limit 500 --json

# Deep map
tvly map "https://example.com" --max-depth 3 --limit 200 --json

Options

OptionDescription
--max-depthLevels deep (1-5, default: 1)
--max-breadthLinks per page (default: 20)
--limitMax URLs to discover (default: 50)
--instructionsNatural language guidance for URL filtering
--select-pathsComma-separated regex patterns to include
--exclude-pathsComma-separated regex patterns to exclude
--select-domainsComma-separated regex for domains to include
--exclude-domainsComma-separated regex for domains to exclude
--allow-external / --no-externalInclude external links
--timeoutMax wait (10-150 seconds)
-o, --outputSave the JSON response to a file
--jsonStructured JSON output

Map + Extract pattern

Use map to find the right page, then extract it. This is often more efficient than crawling an entire site:

# Step 1: Find the authentication docs
tvly map "https://docs.example.com" --instructions "authentication" --json

# Step 2: Extract the specific page you found
tvly extract "https://docs.example.com/api/authentication" --json

Tips

  • Map is URL discovery only — no content extraction. Use extract or crawl for content.
  • Map + extract beats crawl when you only need a few specific pages from a large site.
  • Use --instructions for semantic filtering when path patterns aren't enough.

See also

Comments

Markdown supported