YourAITools

Best web scraping APIs: subscription plans and pay-per-call scrapers

Updated Nov 6, 2026. Listed A to Z, not ranked. Prices change often: confirm with each provider.

Web scraping APIs fetch a page and return its content, usually as clean markdown or JSON for an LLM. They sell two ways: monthly plans with credits or usage (Firecrawl, Apify, Browserbase), or pay per call in USDC over x402, with no account.

The plan table quotes each official pricing page; the directory table reads each listing’s published per-call price. For pages that need logins or clicks, see browser agents.

Subscription scraping plans

ProviderPublished pricingNotes
ApifyFree $0 ($5/month to spend); Starter $19/mo; Scale $199/mo; Business $999/moPrepaid usage plus per-Actor pricing; compute unit $0.2 → $0.13 by plan
BrowserbaseFree (1,000 Fetch calls); Developer $20/mo; Startup $99/mo (10,000 Fetch calls)Fetch $1 per 1k calls after included on Developer, $0.5 on Startup; $4 per 1k with proxies or Extract
FirecrawlFree 1,000 credits/mo; Hobby $19 ($16 yearly); Standard $99 ($83); Growth $399 ($333); Scale $749 ($599)1 credit per page; Search 2 credits per 10 results; extra credits in $5 packs

Quoted from each provider’s official pricing page on Nov 6, 2026.

Scraping APIs in our directory (12)

ToolWhat it doesHow you payPublished priceLinks
ApifyMarketplace of ready-made scrapers and automation tools (Actors) for web data, usable from apps and AI agents.USDC per call (x402)From $1 (prepaid token, amount you choose) per call (listing) (checked 2026-10-27)Listing · Pricing
Browserbase Payment GatewayBrowserbase's crypto gateway: rent headless browser sessions by the hour, or run web search and page fetch per request, paid over x402 or MPP with no API key.USDC per call (x402)$0.01–$0.06 per call (listing) (checked 2026-10-23)Listing · Pricing
ClawFetch.aiWeb rendering, structured extraction, domain search and research for agents, paid per request in USDC on Base.USDC per call (x402)$0.001–$0.005 per call (listing) (checked 2026-10-22)Listing
FastAFWeb scraping and search-results API for agents (Amazon, flights, patents, job boards and more). Use a free API key or pay per call over x402 with no account.USDC per call (x402)$0.005 per call (listing) (checked 2026-10-30)Listing
mdapiZero-setup extraction API for AI agents: give it a URL and get clean Markdown or structured fields back, paid per call in USDC on Base over x402 with no signup.USDC per call (x402)$0.001–$0.005 per call (listing) (checked 2026-10-22)Listing
MinifetchHosted web toolkit for search, scraping, extraction and SEO audits, paid per fetch.USDC per call (x402)$0.001–$0.004 per call (listing) (checked 2026-10-22)Listing
OassisWeb scraping, crawling, browser sessions and research for AI agents through one API and MCP server, with synchronous web tools and background tasks.USDC per call (x402)$0.002–$0.003 per call (listing) (checked 2026-10-28)Listing
readfetchPay-per-call web reading for agents: page text, scrape, map, search and batch reads in USDC on Base, with a free probe first and a signed receipt on every paid response.USDC per call (x402)$0.005 per call (listing) (checked 2026-11-03)Listing
Retriever AI (rtrvr.ai)AI browser agent for Chrome and the cloud. Its agent API sells web page scraping per request over x402.USDC per call (x402)$0.05 per call (listing) (checked 2026-10-22)Listing
ScrapeMolePay-per-call public web data for agents: YouTube search, videos, comments and transcripts, Google Trends, web and news search, SEC filings and more. Errors are not charged.USDC per call (x402)$0.002–$0.01 per call (listing) (checked 2026-10-28)Listing
url2mdTurns PDFs, JavaScript-rendered pages and ordinary HTML into clean Markdown for AI agents, following robots.txt (RFC 9309). $0.005 per call in USDC on Base over x402, with no account or API key.USDC per call (x402)$0.005 per call (listing) (checked 2026-10-22)Listing
WebLensWeb intelligence API for agents: page fetch, content extraction, site maps, PDFs, tech and domain lookups, paid per call over x402, with a free reader tier and MCP.USDC per call (x402)$0.004–$0.005 per call (listing) (checked 2026-10-23)Listing

Plan or per call?

  • Steady volume: a monthly plan’s included credits usually suit thousands of pages a month; check overage rates.
  • Spiky or agent-driven use: per-call scrapers charge only when a page is fetched; x402 scrapers such as Minifetch, mdapi, url2md, readfetch and Retriever AI list $0.001 to $0.05 per call.
  • Specific sites: Apify’s store has ready-made Actors for named sites, billed per result.

Head-to-heads: Apify vs Firecrawl, Firecrawl vs Browserbase, URL-to-markdown APIs.

FAQ

What is the best web scraping API?
There is no single best; we list them A to Z. Firecrawl and Apify suit monthly plans, Browserbase adds full browsers, and per-call APIs such as readfetch, Minifetch and url2md suit agents paying in USDC.
How much does a web scraping API cost?
On Nov 6, 2026: Firecrawl Hobby $19/month for 5,000 credits; Apify Starter $19/month; Browserbase Developer $20/month. x402 scrapers such as Minifetch, readfetch, url2md and Retriever AI list $0.001 to $0.05 per request in our directory.
Is there a free web scraping API?
Firecrawl gives 1,000 credits a month free, Apify’s Free plan includes $5 a month of usage, and Browserbase Free includes 1,000 Fetch calls.

Sources (read Nov 6, 2026): www.firecrawl.dev/pricing · apify.com/pricing · www.browserbase.com/pricing

Picking tools for an agent? Ask other builders + take the free x402 course

Join the community

Keep exploring

Guides