Libraries and SDKs.
One token, every language.
Official, free SDKs for Node, Python, Ruby, PHP, Java, .NET and Go, plus Scrapy and Zapier.
Install in one line, or call the REST API directly over HTTP from anything.
Same call. Pick your language.
One client, typed live. Install, initialize with your token, and crawl. Every language returns identical JSON. Hover to pause and read.
Official SDKs, every major language.
Free, open and dependency-light. Install in one line, initialize with your token, and call the same API from anywhere.
npm i crawlbaseDrop-in client for Node and TypeScript projects.
npm →Pythonpip install crawlbaseInstall and call the Crawlbase class from any Python app.
PyPI →Rubygem install crawlbaseA dependency-free gem for crawling and scraping.
RubyGems →PHPcomposer require crawlbase/crawlbaseA lightweight PHP package for the Crawlbase APIs.
Packagist →Javacom.crawlbase:crawlbase-java-sdk-pomJava SDK for crawling and scraping with Crawlbase.
Maven →.NETdotnet add package CrawlbaseAPIIntegrate the Crawlbase APIs into .NET projects via NuGet.
NuGet →Gogo get github.com/crawlbase/crawlbase-goA lean Go client for the Crawling API.
pkg.go.dev →Scrapypip install scrapy-crawlbase-middlewareCrawlbase middleware for your Scrapy spiders.
PyPI →ZapierWire Crawlbase into no-code Zapier workflows.
Zapier →Any languagecurl https://api.crawlbase.comNo SDK needed. Call the REST API directly over HTTP from anything.
View the docs →Missing one?Built a library or want to collaborate? We would love to work with you.
Contact us →From install to data in four lines.
Easy to deploy, whether you are starting out or running at scale.
Choose your language
Node, Python, Ruby, PHP, Java, .NET or Go. Or skip the SDK and use plain HTTP.
Install the package
One line from your registry: npm, PyPI, RubyGems, Packagist, Maven, NuGet or go get.
Initialize with your token
Create the client with one of your Crawlbase tokens. The same token works everywhere.
Call the API
Pass any URL plus parameters like autoparse or screenshot, and read the response.
Good to know.
Free and open
Every SDK and library is free. You only pay for the Crawling API requests you make, and your first 1,000 are free.
Any language over HTTP
No SDK for your stack? The API is a plain REST endpoint, so you can call it directly from anything that speaks HTTP.
Fully documented
Each SDK is covered in the SDK docs, with copy-paste install and usage examples.
One token, every product
The same token and client cover the Crawling API, the Crawler and every scraper. See usage pricing on the pricing page.
One client, the whole platform.
The SDKs wrap the same network that serves 70,000+ developers. No proxies to buy, no browsers to run, nothing to patch when a site changes.
Install in one line, initialize with your token, and the Crawling API and every scraper are a method call away.
SDK questions.
Install the SDK.
Crawl in four lines.
Free to begin, with 1,000 free Crawling API requests. One token, every language.