Heurist · Extract structured web data with natural language
Extract structured data from web pages using natural language prompts. Process single URLs or entire domains with wildcards.
What it does
Extract structured data from web pages using natural language prompts. Process single URLs or entire domains with wildcards.
- Scrape product specifications from e-commerce sites
- Extract contact information from company websites
- Gather research data from academic domains
- Monitor pricing changes across competitor sites
Ideal buyer
AI agents and developers building web scraping pipelines that need flexible, prompt-based data extraction without maintaining custom parsers.
Run this through your governed agent wallet.
- 01Bootstrap AXON once with
npx @axon402/init. - 02Use the AXON runtime MCP tools to
search_x402_servicesorinspect_x402_offerfor this service. - 03Quote, test-buy, then run the governed paid fetch through AXON.
Send this
Prompt for your agent
A natural-language instruction for your LLM agent — with this endpoint exposed as a tool — to call this resource. Not sent to the endpoint; the endpoint consumes the JSON body below.
Pasting this prompt into a raw ChatGPT or unconfigured agent will notexecute the paid endpoint flow. Run it through an agent with the AXON runtime / MCP tools exposed (see “Use with AXON” above) so the 402 challenge, quote, and governed fetch are handled for you.
“Extract all product names, prices, and availability status from example.com/products/*”
Endpoint request body
The JSON payload your agent sends to the endpoint.
{
"url": "example.com/*",
"extraction_prompt": "Extract product name, price, and stock status from each product page"
}Advanced HTTP details
For integrators who need the raw protocol surface. Most agents should use AXON above instead of calling these directly.
Endpoint URL
curl fallback
curl https://mesh.heurist.xyz/x402/solana/agents/FirecrawlSearchDigestAgent/firecrawl_extract_web_data \ -H "Content-Type: application/json" \ -H "X-PAYMENT: [signed_payment_envelope]" \ -d '{"url":"example.com/*","extraction_prompt":"Extract product name, price, and stock status from each product page"}'
Payment & settlement details
Raw on-chain settlement parameters. AXON above handles these automatically through quote / test-buy / governed fetch.
Price & network
Trust & risk
More in Data APIs
Browse all →Other resources in this category
Category proxy — we don't track live co-purchase signals yet.