npx agentspec-cli install 0f07d1eb-5473-45ba-9aa0-f0e222c0b103 --framework ClaudeCode→ .claude/skills/tavily-map/SKILL.md
# tavily map Discover URLs on a website without extracting content. Faster than crawling. ## Before running any command If `tvly` is not found on PATH, install it first: ```bash curl -fsSL https://cli.tavily.com/install.sh | bash && tvly login ``` Do not skip this step or fall back to other tools. See [tavily-cli](../tavily-cli/SKILL.md) for alternative install methods and auth options. ## When to use - You need to find a specific subpage on a large site - You want a list of all URLs before deciding what to extract or crawl - Step 3 in the [workflow](../tavily-cli/SKILL.md): search → extract → **map** → crawl → research ## Quick start ```bash # Discover all URLs tvly map "https://docs.example.com" --json # With natural language filtering tvly map "https://docs.example.com" --instructions "Find API docs and guides" --json # Filter by path tvly map "https://example.com" --select-paths "/blog/.*" --limit 500 --json # Deep map tvly map "https://example.com" --max-depth 3 --limit 200 --json ``` ## Options | Option | Description | |--------|-------------| | `--max-depth` | Levels deep (1-5, default: 1) | | `--max-breadth` | Links per page (default: 20) | | `--limit` | Max URLs to discover (default: 50) | | `--instructions` | Natural language guidance for URL filtering | | `--select-paths` | Comma-separated regex patterns to include | | `--exclude-paths` | Comma-separated regex patterns to exclude | | `--select-domains` | Comma-separated regex for domains to include | | `--exclude-domains` | Comma-separated regex for domains to exclude | | `--allow-external / --no-external` | Include external links | | `--timeout` | Max wait (10-150 seconds) | | `-o, --output` | Save output to file | | `--json` | Structured JSON output | ## Map + Extract pattern Use `map` to find the right page, then `extract` it. This is often more efficient than crawling an entire site: ```bash # Step 1: Find the authentication docs tvly map "https://docs.example.com" --instructions "authentication" --json # Step 2: Extract the specific page you found tvly extract "https://docs.example.com/api/authentication" --json ``` ## Tips - **Map is URL discovery only** — no content extraction. Use `extract` or `crawl` for content. - **Map + extract beats crawl** when you only need a few specific pages from a large site. - **Use `--instructions`** for semantic filtering when path patterns aren't enough. ## See also - [tavily-extract](../tavily-extract/SKILL.md) — extract content from URLs you discover - [tavily-crawl](../tavily-crawl/SKILL.md) — bulk extract when you need many pages
Built on the Agent Skills standard
tavily-cli
Web search, content extraction, crawling, and deep research via the Tavily CLI. Use this skill whenever the user wants to search the web, find articles, research a topic, look something up online, extract content from a URL, grab text from a webpage, crawl documentation, download a site's pages, discover URLs on a domain, or conduct in-depth research with citations. Also use when they say "fetch this page", "pull the content from", "get the page at https://", "find me articles about", or reference extractin
by AgentHub Crawler
tavily-extract
Extract clean markdown or text content from specific URLs via the Tavily CLI. Use this skill when the user has one or more URLs and wants their content, says "extract", "grab the content from", "pull the text from", "get the page at", "read this webpage", or needs clean text from web pages. Handles JavaScript-rendered pages, returns LLM-optimized markdown, and supports query-focused chunking for targeted extraction. Can process up to 20 URLs in a single call.
by AgentHub Crawler
Sign in to leave a comment.
tavily-crawl
Crawl websites and extract content from multiple pages via the Tavily CLI. Use this skill when the user wants to crawl a site, download documentation, extract an entire docs section, bulk-extract pages, save a site as local markdown files, or says "crawl", "get all the pages", "download the docs", "extract everything under /docs", "bulk extract", or needs content from many pages on the same domain. Supports depth/breadth control, path filtering, semantic instructions, and saving each page as a local markdow
by AgentHub Crawler