npx agentspec-cli install 667d6f10-c777-4c60-bf24-c3c150884a5b --framework ClaudeCode→ .claude/skills/tavily-extract/SKILL.md
# tavily extract Extract clean markdown or text content from one or more URLs. ## Before running any command If `tvly` is not found on PATH, install it first: ```bash curl -fsSL https://cli.tavily.com/install.sh | bash && tvly login ``` Do not skip this step or fall back to other tools. See [tavily-cli](../tavily-cli/SKILL.md) for alternative install methods and auth options. ## When to use - You have a specific URL and want its content - You need text from JavaScript-rendered pages - Step 2 in the [workflow](../tavily-cli/SKILL.md): search → **extract** → map → crawl → research ## Quick start ```bash # Single URL tvly extract "https://example.com/article" --json # Multiple URLs tvly extract "https://example.com/page1" "https://example.com/page2" --json # Query-focused extraction (returns relevant chunks only) tvly extract "https://example.com/docs" --query "authentication API" --chunks-per-source 3 --json # JS-heavy pages tvly extract "https://app.example.com" --extract-depth advanced --json # Save to file tvly extract "https://example.com/article" -o article.md ``` ## Options | Option | Description | |--------|-------------| | `--query` | Rerank chunks by relevance to this query | | `--chunks-per-source` | Chunks per URL (1-5, requires `--query`) | | `--extract-depth` | `basic` (default) or `advanced` (for JS pages) | | `--format` | `markdown` (default) or `text` | | `--include-images` | Include image URLs | | `--timeout` | Max wait time (1-60 seconds) | | `-o, --output` | Save output to file | | `--json` | Structured JSON output | ## Extract depth | Depth | When to use | |-------|-------------| | `basic` | Simple pages, fast — try this first | | `advanced` | JS-rendered SPAs, dynamic content, tables | ## Tips - **Max 20 URLs per request** — batch larger lists into multiple calls. - **Use `--query` + `--chunks-per-source`** to get only relevant content instead of full pages. - **Try `basic` first**, fall back to `advanced` if content is missing. - **Set `--timeout`** for slow pages (up to 60s). - If search results already contain the content you need (via `--include-raw-content`), skip the extract step. ## See also - [tavily-search](../tavily-search/SKILL.md) — find pages when you don't have a URL - [tavily-crawl](../tavily-crawl/SKILL.md) — extract content from many pages on a site
Built on the Agent Skills standard
tavily-cli
Web search, content extraction, crawling, and deep research via the Tavily CLI. Use this skill whenever the user wants to search the web, find articles, research a topic, look something up online, extract content from a URL, grab text from a webpage, crawl documentation, download a site's pages, discover URLs on a domain, or conduct in-depth research with citations. Also use when they say "fetch this page", "pull the content from", "get the page at https://", "find me articles about", or reference extractin
by AgentHub Crawler
tavily-crawl
Crawl websites and extract content from multiple pages via the Tavily CLI. Use this skill when the user wants to crawl a site, download documentation, extract an entire docs section, bulk-extract pages, save a site as local markdown files, or says "crawl", "get all the pages", "download the docs", "extract everything under /docs", "bulk extract", or needs content from many pages on the same domain. Supports depth/breadth control, path filtering, semantic instructions, and saving each page as a local markdow
by AgentHub Crawler
Sign in to leave a comment.
tavily-map
Discover and list all URLs on a website without extracting content, via the Tavily CLI. Use this skill when the user wants to find a specific page on a large site, list all URLs, see the site structure, find where something is on a domain, or says "map the site", "find the URL for", "what pages are on", "list all pages", or "site structure". Faster than crawling — returns URLs only. Essential when you know the site but not the exact page. Combine with extract for targeted content retrieval.
by AgentHub Crawler