Repository navigation
Expand file tree
/
Copy pathfirecrawl.yaml
More file actions
98 lines (98 loc) · 2.81 KB
/
Copy pathfirecrawl.yaml
File metadata and controls
98 lines (98 loc) · 2.81 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
id: firecrawl
name: Firecrawl MCP Server
description: >
MCP server for Firecrawl's web scraping and crawling API. Converts any website into
clean, LLM-ready markdown or structured data. Supports single page scraping, multi-page
crawling with depth control, sitemap-based extraction, and batch operations. Handles
JavaScript-rendered pages, bypasses common anti-bot measures, and returns structured
content suitable for RAG pipelines and knowledge base construction.
author:
name: Mendable
github: mendableai
repository: https://github.com/mendableai/firecrawl-mcp-server
transport:
- stdio
category: Research
tags:
- web-scraping
- crawling
- markdown
- rag
- content-extraction
- data-pipeline
created_at: "2025-03-10T00:00:00.000Z"
updated_at: "2026-05-26T00:00:00.000Z"
tools:
- name: firecrawl_scrape
description: Scrape a single URL and return clean markdown or structured content.
input_schema:
type: object
properties:
url:
type: string
description: URL to scrape
formats:
type: array
items:
type: string
description: Output formats (markdown, html, rawHtml, links, screenshot)
onlyMainContent:
type: boolean
description: Extract only the main content, removing nav/footer/ads
waitFor:
type: integer
description: Milliseconds to wait for JavaScript rendering
required:
- url
- name: firecrawl_crawl
description: Crawl a website starting from a URL, following links up to a specified depth.
input_schema:
type: object
properties:
url:
type: string
description: Starting URL for the crawl
maxDepth:
type: integer
description: Maximum link depth to crawl (default 2)
limit:
type: integer
description: Maximum number of pages to crawl
includePaths:
type: array
items:
type: string
description: Only crawl URLs matching these glob patterns
excludePaths:
type: array
items:
type: string
description: Skip URLs matching these glob patterns
required:
- url
- name: firecrawl_map
description: Discover all URLs on a website using its sitemap or by crawling.
input_schema:
type: object
properties:
url:
type: string
description: Website URL to map
limit:
type: integer
description: Maximum number of URLs to return
required:
- url
install:
npm: "firecrawl-mcp"
command: npx
args:
- "-y"
- "firecrawl-mcp"
env_vars:
- name: FIRECRAWL_API_KEY
description: Firecrawl API key for authentication
required: true
license: MIT
version: "1.6.0"
stars: 3250