mcpField
T
tavily-search-and-fetch

tavily-search-and-fetch

github.com/rioiartProductivity038 installsUpdated 37w ago
Repository

About tavily-search-and-fetch

A command-line skill for web research through Tavily APIs, aimed at users who need search, page extraction, site URL discovery, or cited research reports. Separate scripts provide task-specific options, including domain and date filters and structured output.

Key features

  1. 01Search web results with filters
  2. 02Extract content from up to 20 URLs
  3. 03Discover site URLs with sitemap
  4. 04Generate cited research reports
  5. 05Save structured output to a file

Use cases

  1. 01Check a recent news topic
  2. 02Collect content from selected articles
  3. 03Map pages in a documentation site
  4. 04Create a cited comparison report

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/rioiart/tavily-skill --skill tavily-search-and-fetch

After installing, type/tavily-search-and-fetchin Claude Code to confirm it loaded.

Bundled files

References and scripts installed along with SKILL.md.

LICENSE
references/
api_reference.md
scripts/
tavily_crawl.sh
tavily_extract.sh
tavily_research.sh
tavily_search.sh
tavily_sitemap.sh

Details

From the project README

Tavily Researcher

Web research via Tavily's LLM-optimized APIs: search, extract, sitemap, and research.

Setup

Requires TAVILY_API_KEY environment variable. Get a free key (1000 credits/month) at https://app.tavily.com

Choosing the Right Tool

NeedScript
Web search resultstavily_search.sh
Content from specific URLstavily_extract.sh
Discover URLs on a site (fast)tavily_sitemap.sh
AI-synthesized report with citationstavily_research.sh

Quick Start

Search
scripts/tavily_search.sh "What is retrieval augmented generation?" --include-answer
News Search
scripts/tavily_search.sh "AI regulation updates" --topic news --time-range week
Extract Content from URLs
scripts/tavily_extract.sh https://example.com/article1 https://example.com/article2
Discover URLs on a Site
scripts/tavily_sitemap.sh https://docs.example.com --max-depth 2 --limit 100
AI Research Report
scripts/tavily_research.sh "Compare LangGraph vs CrewAI for multi-agent systems" --model pro

Scripts

tavily_search.sh

Standard web search. Returns titles, URLs, snippets, and optional AI answer.

Key options:

  • --depth ultra-fast|fast|basic|advanced — Trade speed for relevance
  • --topic general|news|finance — Optimize for content type
  • --include-answer — Get AI-generated summary
  • --include-raw-content — Get full page content
  • --time-range day|week|month|year — Filter by recency
  • --chunks-per-source N — Chunks per source (1-5, advanced/fast)
  • --include-domains / --exclude-domains — Filter sources
tavily_extract.sh

Extract full content from specific URLs (up to 20 at once).

Key options:

  • --depth basic|advanced — Use advanced for JS-heavy pages
  • --query TEXT — Rerank chunks by relevance
  • --chunks-per-source N — Return only relevant chunks (1-5, requires --query)
  • --format markdown|text — Output format
tavily_sitemap.sh

Discover URLs on a website without extracting content. Faster than crawl — use to understand site structure first.

Key options:

  • --max-depth N — Crawl depth 1-5 (start with 1)
  • --limit N — Total URLs cap (default: 50)
  • --instructions TEXT — Focus on specific types of pages
tavily_research.sh

AI-synthesized research with citations. Takes 30-120 seconds.

Key options:

  • --model mini|pro|auto — mini for focused queries, pro for comprehensive analysis
  • --citation-format numbered|mla|apa|chicago
  • --output-schema JSON — Get structured JSON output
  • --output-file PATH — Save results to file

Cost Optimization

TaskRecommended ApproachCredits
Quick fact checktavily_search.sh --include-answer1
Deeper searchtavily_search.sh --depth advanced2
Full article contenttavily_extract.sh <urls>1 per 5 URLs
Discover site URLstavily_sitemap.sh1
AI research reporttavily_research.shvaries

Domain-Specific Search

# Only search specific sites
scripts/tavily_search.sh "async python" --include-domains docs.python.org,realpython.com

# Exclude unreliable sources
scripts/tavily_search.sh "health advice" --exclude-domains reddit.com,quora.com

API Reference

See references/api_reference.md for full parameter documentation.

Comments

Markdown supported