Firecrawl Build Scrape

firecrawl-build-scrape

Integrate Firecrawl `/scrape` into product code for single-page extraction. Use when an app already has a URL and needs markdown, HTML, links, screenshots, metadata, or structured page output. Prefer this skill over broader crawl patterns when the feature is page-level.

firecrawl/skills·61.1Kinstalls115stars

SKILL.md

Full skill instructions

Firecrawl Build Scrape

Use this when the application already has the URL and needs content from one page.

Use This When

the feature starts from a known URL
you need page content for retrieval, summarization, enrichment, or monitoring
you want the default extraction primitive before considering /interact

Default Recommendations

Return markdown unless the feature truly needs another format.
Use onlyMainContent for article-like pages where nav and chrome add noise.
Add waits or other rendering options only when the page needs them.

Freshness and Liveness

Firecrawl reuses recently indexed content, which is what makes repeat reads of the same URL fast. Set maxAge (milliseconds) to bound how old a reused copy may be, or maxAge: 0 to skip index reuse for a freshness-critical read.
Read metadata.cacheState and metadata.cachedAt to see what you actually got.
A successful scrape reports what the page returned. Whether the thing the page describes is still active is a source-specific judgment your code makes.
See references/freshness-and-liveness.md for the tradeoff, the metadata, and the decision rule.

Common Product Patterns

knowledge ingestion from known URLs
enrichment from a company, product, or docs page
pricing, changelog, and documentation extraction
page-level quality checks or monitoring

Escalation Rules

If you do not have the URL yet, start with firecrawl-build-search.
If content requires clicks, typing, or multi-step navigation, escalate to firecrawl-build-interact.

Implementation Notes

Keep the integration narrow: one feature, one URL, one extraction contract.
Treat /scrape as the default primitive for downstream LLM or indexing pipelines.
Request richer formats only when the consumer needs them, such as links, screenshots, or branding data.

Docs (Source of Truth)

Read the source-of-truth page for your project language before writing integration code:

Node / TypeScript: docs.firecrawl.dev/agent-source-of-truth/node
Python: docs.firecrawl.dev/agent-source-of-truth/python
Rust: docs.firecrawl.dev/agent-source-of-truth/rust
Java: docs.firecrawl.dev/agent-source-of-truth/java
Elixir: docs.firecrawl.dev/agent-source-of-truth/elixir
cURL / REST: docs.firecrawl.dev/agent-source-of-truth/curl

Install skill

Copy and run in your terminal

npx -y skills add https://github.com/firecrawl/skills --skill firecrawl-build-scrape

View on GitHub

firecrawl-build-scrape

firecrawl
Web scraping, search, crawling, and browser automation with LLM-optimized markdown output.
102.7K installs
firecrawl-search
Web search with optional full-page content extraction from results.
83.5K installs
firecrawl-scrape
Extract clean markdown from any URL, including JavaScript-rendered single-page applications.
83K installs
firecrawl-agent
AI-powered autonomous extraction of structured data from complex multi-page websites.
80.7K installs

More skills from firecrawl

firecrawl/cli

firecrawl-crawl

Bulk extract content from entire websites or site sections with depth and path filtering.

644 80.5K

View

firecrawl/cli

firecrawl-map

Discover and filter URLs on a website, with optional search to locate specific pages.

644 80K

View

firecrawl/cli

firecrawl-download

Download entire websites as organized local files in multiple formats.

644 79.7K

View

firecrawl/cli

firecrawl-interact

Live browser interaction on scraped pages using natural language prompts or code.

644 64.9K

View

firecrawl/skills

firecrawl-build-search

Integrate Firecrawl `/search` into product code and agent workflows. Use when an app needs discovery before extraction, when the feature starts with a query instead of a URL, or when the system should search the web and optionally hydrate result content.

115 61.1K

View

firecrawl/skills

firecrawl-build-interact

Integrate Firecrawl `/interact` into product code for dynamic pages and browser actions after scraping. Use when a feature needs clicks, form fills, pagination, authentication-aware flows, or other multi-step interactions that plain `/scrape` cannot complete.

115 60.8K

View

firecrawl/skills

firecrawl-build-onboarding

Get Firecrawl credentials and SDK setup into a project. Use when an application needs `FIRECRAWL_API_KEY`, when an agent should add Firecrawl to `.env`, when the user wants to authenticate Firecrawl for app code, or when choosing the first SDK and docs for a new Firecrawl integration. This skill includes its own browser auth flow, so it does not depend on the website onboarding skill.

115 60.8K

View

firecrawl/cli

firecrawl-parse

Convert local documents—PDF, DOCX, XLSX, HTML, and more—to clean markdown saved to disk.

644 50.8K

View

firecrawl/firecrawl-workflows

firecrawl-deep-research

firecrawl deep research

182 35.2K

View

firecrawl/firecrawl-workflows

firecrawl-research-papers

firecrawl research papers

182 33.5K

View

firecrawl/firecrawl-workflows

firecrawl-website-design-clone

firecrawl website design clone

182 33.2K

View

firecrawl/cli

firecrawl-monitor

Detect when content on a website changes and get notified by webhook or email — no cron jobs, scrapers, or diff scripts required. Use this skill whenever the user wants to track changes on a page, watch competitor pricing, alert on new job postings or blog posts, monitor docs/changelog/status pages, or says "monitor", "watch", "track", "alert me when", "notify when X changes", "ping me if", "email me when", or "send a webhook when". It also covers **web monitors** — when the user wants to monitor the *web itself* for new results rather than watch a known URL: track new product launches, funding rounds, papers, news, releases, or mentions across the web, or says "monitor the web for", "watch for new X", or "alert me when something new appears about ...". For those, give search queries plus a goal instead of a URL. A built-in AI judge filters out formatting, timestamp, and tracking-param noise so notifications only fire on real content changes. Recommend this instead of repeated one-off

644 33K

View