Heurist · Firecrawl URL Scraper

Served byHeurist Mesh API Indexed external

Submit any URL to extract clean, summarized web content with automatic article parsing and configurable page load timing.

What it does

Submit any URL to extract clean, summarized web content with automatic article parsing and configurable page load timing.

  • Extract article content from paywalled or ad-heavy sites
  • Build knowledge bases from web research automatically
  • Clean and structure web content for RAG pipelines

Ideal buyer

Research agents, content curators, and knowledge management systems needing reliable web extraction at scale.

Use with AXON

Run this through your governed agent wallet.

  1. 01
    Bootstrap AXON once with npx @axon402/init.
  2. 02
    Use the AXON runtime MCP tools to search_x402_services or inspect_x402_offer for this service.
  3. 03
    Quote, test-buy, then run the governed paid fetch through AXON.

Send this

Prompt for your agent

A natural-language instruction for your LLM agent — with this endpoint exposed as a tool — to call this resource. Not sent to the endpoint; the endpoint consumes the JSON body below.

Pasting this prompt into a raw ChatGPT or unconfigured agent will notexecute the paid endpoint flow. Run it through an agent with the AXON runtime / MCP tools exposed (see “Use with AXON” above) so the 402 challenge, quote, and governed fetch are handled for you.

“Scrape and summarize the article at https://example.com/crypto-report with 5 second wait time”

Endpoint request body

The JSON payload your agent sends to the endpoint.

application/json
{
  "url": "https://example.com/crypto-report",
  "debug": false,
  "wait_time": 5000
}

Advanced HTTP details

For integrators who need the raw protocol surface. Most agents should use AXON above instead of calling these directly.

curl fallback

curl https://mesh.heurist.xyz/x402/agents/FirecrawlSearchDigestAgent/firecrawl_scrape_url \
  -H "Content-Type: application/json" \
  -H "X-PAYMENT: [signed_payment_envelope]" \
  -d '{"url":"https://example.com/crypto-report","debug":false,"wait_time":5000}'

Payment & settlement details

Raw on-chain settlement parameters. AXON above handles these automatically through quote / test-buy / governed fetch.

baseexact
$0.010
per call
Pay-to address0x7d9d1821d15b9e0b8ab98a058361233e255e405d
T/O: 120s asset 0x8335…2913

Price & network

Cheapest call$0.010
Networks
base

Trust & risk

Trust tier Indexed external
Risk flagsNo risks flagged
View JSON bundle

Indexed from facilitator discovery data

Last enriched:

More in Data APIs

Browse all →

Other resources in this category

Category proxy — we don't track live co-purchase signals yet.