SerenAI
SerenAI
Firecrawl logo

Firecrawl Web Scraping API

by Firecrawl

370 txns
3 agents

About

AI-powered web scraping API that turns websites into LLM-ready markdown or structured data. Supports scraping single pages, crawling entire sites, mapping website structures, and searching the web with one API call.

Categories

web-scrapingaidata-extractioncrawling

Access Data

For AI Agents

MCP Server

Install the x402 MCP server to let your AI agent access this data with automatic USDC payments on Base.

Required: You need a SerenDB database to store query results.

Get your connection string from the SerenDB Console under your database settings.

Claude Desktop

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "x402": {
      "command": "npx",
      "args": ["@serendb/x402-mcp-server"],
      "env": {
        "X402_GATEWAY_URL": "https://x402.serendb.com",
        "WALLET_PRIVATE_KEY": "0x...",
        "BASE_RPC_URL": "https://mainnet.base.org",
        "SERENDB_CONNECTION_STRING": "postgresql://..."
      }
    }
  }
}
Claude Code

Replace 0x... with your wallet private key and postgresql://... with your SerenDB connection string.

macOS / Linux
claude mcp add x402 \
  -e X402_GATEWAY_URL=https://x402.serendb.com \
  -e WALLET_PRIVATE_KEY=0x... \
  -e BASE_RPC_URL=https://mainnet.base.org \
  -e "SERENDB_CONNECTION_STRING=postgresql://..." \
  -- npx -y @serendb/x402-mcp-server
Windows (PowerShell)
claude mcp add x402 `
  -e X402_GATEWAY_URL=https://x402.serendb.com `
  -e WALLET_PRIVATE_KEY=0x... `
  -e BASE_RPC_URL=https://mainnet.base.org `
  -e "SERENDB_CONNECTION_STRING=postgresql://..." `
  '--' npx -y @serendb/x402-mcp-server
Gemini CLI

Replace 0x... with your wallet private key and postgresql://... with your SerenDB connection string.

gemini mcp add x402 \
  -e X402_GATEWAY_URL=https://x402.serendb.com \
  -e WALLET_PRIVATE_KEY=0x... \
  -e BASE_RPC_URL=https://mainnet.base.org \
  -e "SERENDB_CONNECTION_STRING=postgresql://..." \
  -- npx -y @serendb/x402-mcp-server
Codex CLI

Replace 0x... with your wallet private key and postgresql://... with your SerenDB connection string.

codex mcp add x402 \
  --env X402_GATEWAY_URL=https://x402.serendb.com \
  --env WALLET_PRIVATE_KEY=0x... \
  --env BASE_RPC_URL=https://mainnet.base.org \
  --env "SERENDB_CONNECTION_STRING=postgresql://..." \
  -- npx -y @serendb/x402-mcp-server
Cursor

Important: Cursor has a 60s timeout. Pre-install globally first: npm install -g @serendb/x402-mcp-server

First, install globally to avoid timeout issues:

npm install -g @serendb/x402-mcp-server

Then add to ~/.cursor/mcp.json:

{
  "mcpServers": {
    "x402": {
      "command": "x402-mcp-server",
      "args": [],
      "env": {
        "X402_GATEWAY_URL": "https://x402.serendb.com",
        "WALLET_PRIVATE_KEY": "0x...",
        "BASE_RPC_URL": "https://mainnet.base.org",
        "SERENDB_CONNECTION_STRING": "postgresql://..."
      }
    }
  }
}

Also works with Windsurf, Zed, and other MCP-compatible clients. See the full setup guide for details.

Full Setup GuideGet Connection Stringnpm Package

For Developers

Direct HTTP API

Access data directly via HTTP using the x402 payment protocol.

How x402 Payments Work
  1. Send your query request to the gateway
  2. Receive HTTP 402 with payment requirements (amount, wallet, EIP-712 data)
  3. Sign the payment authorization with your wallet
  4. Retry request with X-PAYMENT header containing the signature
  5. Receive your data - payment settles automatically via USDC on Base
Step 1: Get Payment Requirements
curl -X POST https://x402.serendb.com/api/proxy \
  -H "Content-Type: application/json" \
  -d '{
    "publisherId": "3f6868de-3f3f-4f42-8767-c4595c0c0cbc",
    "agentWallet": "0xYourWalletAddress",
    "request": {
      "method": "GET",
      "path": "/endpoint"
    }
  }'

This returns 402 Payment Required with the payment details you need to sign.

Step 2: Add Payment Header

After signing the EIP-712 authorization, add the base64-encoded signature:

curl -X POST https://x402.serendb.com/api/proxy \
  -H "Content-Type: application/json" \
  -H "X-PAYMENT: <base64-encoded-signature>" \
  -d '{ ... }'
Get Help on Discord

Example Prompts

Copy these prompts to use with your AI assistant. Make sure you have the x402 MCP server configured.

Getting Started
Using the x402 MCP server, use Firecrawl to scrape a website and extract its content as markdown. Start with https://example.com and convert it to clean, readable markdown format. What are the main sections and content structure?
Research
Using the x402 MCP server, use Firecrawl to map the structure of a website: analyze the site structure, identify all main pages and sections, and create a navigation blueprint. What are the key pages and how are they organized?
Analysis
Using the x402 MCP server, use Firecrawl to extract and analyze competitor website content. Crawl a competitor's entire website (limit to 20 pages), extract all content as markdown, and identify: main products/services offered, pricing information, key messaging, and call-to-action buttons.
Comparison
Using the x402 MCP server, use Firecrawl to compare three competitor websites. Scrape the homepage and product/service pages from each, extract content as markdown, and compare: content quality, messaging focus, CTA clarity, and overall site structure. Which site is most effective?
discovery
Using the x402 MCP server, use Firecrawl to perform web search and content extraction: search for 'AI agents 2025' and scrape the top results. Extract key insights from each result and identify: emerging trends, key players, and important announcements in the AI agent space.

Pricing

$0.0020/call

Pay per API call via x402 protocol

Publisher Details

Type: api
Added: December 16, 2025
Cache TTL: 300s