Heurist · Scrape and Summarize Web URL (Firecrawl)

Served byHeurist Mesh API Indexed external

Scrape any URL and receive cleaned, summarized web content using Firecrawl infrastructure.

What it does

Scrape any URL and receive cleaned, summarized web content using Firecrawl infrastructure.

  • Extract article content for RAG pipelines
  • Monitor competitor pricing pages
  • Archive web content in structured format
  • Generate summaries for research reports

Ideal buyer

AI agents and developers needing reliable web scraping with automatic content cleaning.

Use with AXON

Run this through your governed agent wallet.

  1. 01
    Bootstrap AXON once with npx @axon402/init.
  2. 02
    Use the AXON runtime MCP tools to search_x402_services or inspect_x402_offer for this service.
  3. 03
    Quote, test-buy, then run the governed paid fetch through AXON.

Send this

Prompt for your agent

A natural-language instruction for your LLM agent — with this endpoint exposed as a tool — to call this resource. Not sent to the endpoint; the endpoint consumes the JSON body below.

Pasting this prompt into a raw ChatGPT or unconfigured agent will notexecute the paid endpoint flow. Run it through an agent with the AXON runtime / MCP tools exposed (see “Use with AXON” above) so the 402 challenge, quote, and governed fetch are handled for you.

“Scrape https://example.com/article and return the cleaned article text and a brief summary.”

Endpoint request body

The JSON payload your agent sends to the endpoint.

application/json
{
  "url": "https://example.com/article",
  "debug": false,
  "wait_time": 2000
}

Advanced HTTP details

For integrators who need the raw protocol surface. Most agents should use AXON above instead of calling these directly.

curl fallback

curl https://mesh.heurist.xyz/x402/solana/agents/FirecrawlSearchDigestAgent/firecrawl_scrape_url \
  -H "Content-Type: application/json" \
  -H "X-PAYMENT: [signed_payment_envelope]" \
  -d '{"url":"https://example.com/article","debug":false,"wait_time":2000}'

Payment & settlement details

Raw on-chain settlement parameters. AXON above handles these automatically through quote / test-buy / governed fetch.

solanaexact
$0.010
per call
Pay-to addressEAjHeMbh74YTddmTCWQ6PMXaR3fJPzKG9VEdKR4mPCcc
T/O: 120s asset EPjFWd…Dt1v

Price & network

Cheapest call$0.010
Networks
solana

Trust & risk

Trust tier Indexed external
Risk flagsNo risks flagged
View JSON bundle

Indexed from facilitator discovery data

Last enriched:

More in Data APIs

Browse all →

Other resources in this category

Category proxy — we don't track live co-purchase signals yet.