Web data,
made effortless.
Take your scrapers the extra mile.
Everything you wanted to know
If your question isn't here, ping our team, they reply fast.
What is Crawlbase?
Crawlbase is web data infrastructure for developers, enterprises, and LLMs. One account and token cover the Crawling API, the asynchronous Enterprise Crawler, Smart AI Proxy, Cloud Storage, and the Web MCP for AI agents, with residential proxies, JavaScript rendering, and anti-bot handling built in. See the full docs.
Do I need a credit card to start?
No. Every new account starts with up to 10,000 free successful requests and no credit card, so you can test every output (HTML, JSON, Markdown, and screenshots) first. Add a card only when you need more volume; usage-based plans are on the pricing page.
Which languages and SDKs are supported?
The API is plain HTTP, so any language that can make a request works. We ship official SDKs for Python, Node, Ruby, PHP, and Go, plus community libraries for more languages. See all libraries.
What happens if a request fails?
You are only billed for successful requests. The Crawling API retries automatically with different proxies and headers on a soft failure, and a request counts toward your quota only when it succeeds: timeouts, blocks, and target 5xx errors are free, so retrying is safe. Details are in the Crawling API docs.
Can I geolocate requests to a specific country?
Yes. Add a country parameter with a two-letter ISO code (for example country=US or country=DE) and the request is routed through residential exit nodes in that region, across two dozen-plus countries. Crawlbase may auto-select the best proxy for a given site to keep success rates high. See the country parameter in the Crawling API docs.