> Web page scraping
// Fetches and returns the content of a web page
Fetches and returns the content of a web page. Agents can request it by capability ID web.scrape, or by plain intent — EntRoute resolves phrases like “scrape page”, “fetch page” and “get webpage” to this capability.
EntRoute currently lists 2 endpoints from 2 providers for web.scrape, priced from $0.003 to $0.01 per call, settled in USDC on Base. The quickest responds in about 155ms at the 95th percentile. Every endpoint below is re-probed every 10 minutes for a valid 402 payment challenge; the ordering blends measured success rate, latency and price rather than provider claims.
These phrases resolve to this capability with intent-based discovery.
curl -X POST https://api.entroute.com/discover \ -H "Content-Type: application/json" \ -d '{"capability_id": "web.scrape"}'
https://api.zyte.com/v1/extract https://api.firecrawl.dev/v1/x402/scrape {
"url": "https://example.com/page",
"formats": [
"markdown",
"html"
]
}{
"markdown": "# Page Title\n\nContent here...",
"html": "<h1>Page Title</h1><p>Content here...</p>",
"metadata": {
"title": "Page Title",
"description": "A description"
}
}Use this capability in your agent or application:
Frequently asked questions about Web page scraping
How much does a web page scraping API call cost?
Endpoints listed for web.scrape on EntRoute are priced from $0.003 to $0.01 per call. Payment is per request — there is no subscription, account or API key. Prices shown are read from each endpoint's live 402 response, not from a provider-supplied catalogue.
How do AI agents pay for web page scraping endpoints?
Via the x402 protocol. The agent calls the endpoint, receives an HTTP 402 Payment Required response describing the price and recipient, signs a stablecoin payment (USDC on Base), and retries the request with proof of payment. The whole exchange takes seconds and needs no human approval.
How many providers offer web page scraping?
2 endpoints are currently listed for web.scrape across 2 providers. That number moves as endpoints are added and as failing ones are demoted.
Are these web page scraping endpoints verified?
Each one is probed every 10 minutes to confirm it still returns a well-formed 402 challenge on a payable network. Endpoints whose 7-day success rate drops below 50% are moved out of the ranked list into fallbacks with an explicit exclusion reason, so an agent can decide whether to retry them.