Product / Libraries and SDKs

Libraries and SDKs.
One token, every language.

Official, free SDKs for Node, Python, Ruby, PHP, Java, .NET and Go, plus Scrapy and Zapier.
Install in one line, or call the REST API directly over HTTP from anything.

Start freeRead the docs
7 languages, 2 integrationsFree and opennpm · PyPI · RubyGems · Packagist
Your codeSame resultsany languageone clientSDK ClientInstallInitCallRendered HTMLStructured JSONScreenshotapi.get(url)autoparse: truescreenshot: truesdk call · one token · 200
Live SDK calls1.24M req/minStreaming
200ebay.com/itm/195830173SG154ms
200zillow.com/homedetails/123US195ms
200zillow.com/homedetails/123SG139ms
301tripadvisor.com/Hotel_Review-g60763IN180ms
200google.com/search?q=4k+tvGB64ms
200tripadvisor.com/Hotel_Review-g60763BR107ms
200yelp.com/biz/blue-bottle-sfBR134ms
200tripadvisor.com/Hotel_Review-g60763IN167ms
200target.com/p/-/A-79348122FR185ms
200yelp.com/biz/blue-bottle-sfFR215ms
200yelp.com/biz/blue-bottle-sfDE70ms
200tripadvisor.com/Hotel_Review-g60763NL148ms
200glassdoor.com/Reviews/googleCA150ms
200producthunt.com/posts/notionFR106ms
200github.com/crawlbaseBR141ms
200amazon.com/dp/B08N5JZGGWBR80ms
301amazon.com/dp/B08N5JZGGWNL174ms
200ebay.com/itm/195830173IN43ms
200google.com/search?q=4k+tvES83ms
200zillow.com/homedetails/123BR118ms
200etsy.com/listing/1029384GB196ms
200yelp.com/biz/blue-bottle-sfBR179ms
301glassdoor.com/Reviews/googleAU80ms
200tripadvisor.com/Hotel_Review-g60763NL124ms
200indeed.com/viewjob?jk=8a1cES208ms
200indeed.com/viewjob?jk=8a1cJP49ms
200ebay.com/itm/195830173SG154ms
200zillow.com/homedetails/123US195ms
200zillow.com/homedetails/123SG139ms
301tripadvisor.com/Hotel_Review-g60763IN180ms
200google.com/search?q=4k+tvGB64ms
200tripadvisor.com/Hotel_Review-g60763BR107ms
200yelp.com/biz/blue-bottle-sfBR134ms
200tripadvisor.com/Hotel_Review-g60763IN167ms
200target.com/p/-/A-79348122FR185ms
200yelp.com/biz/blue-bottle-sfFR215ms
200yelp.com/biz/blue-bottle-sfDE70ms
200tripadvisor.com/Hotel_Review-g60763NL148ms
200glassdoor.com/Reviews/googleCA150ms
200producthunt.com/posts/notionFR106ms
200github.com/crawlbaseBR141ms
200amazon.com/dp/B08N5JZGGWBR80ms
301amazon.com/dp/B08N5JZGGWNL174ms
200ebay.com/itm/195830173IN43ms
200google.com/search?q=4k+tvES83ms
200zillow.com/homedetails/123BR118ms
200etsy.com/listing/1029384GB196ms
200yelp.com/biz/blue-bottle-sfBR179ms
301glassdoor.com/Reviews/googleAU80ms
200tripadvisor.com/Hotel_Review-g60763NL124ms
200indeed.com/viewjob?jk=8a1cES208ms
200indeed.com/viewjob?jk=8a1cJP49ms
01 Live demo

Same call. Pick your language.

One client, typed live. Install, initialize with your token, and crawl. Every language returns identical JSON. Hover to pause and read.

ready
keys 1-5 switch · click to pauserun your own URL
Run your first request in minutes. Up to 10,000 free requests, no credit card.Start free
02 Libraries

Official SDKs, every major language.

Free, open and dependency-light. Install in one line, initialize with your token, and call the same API from anywhere.

Node.jsnpm i crawlbase

Drop-in client for Node and TypeScript projects.

npm →Pythonpip install crawlbase

Install and call the Crawlbase class from any Python app.

PyPI →Rubygem install crawlbase

A dependency-free gem for crawling and scraping.

RubyGems →PHPcomposer require crawlbase/crawlbase

A lightweight PHP package for the Crawlbase APIs.

Packagist →Javacom.crawlbase:crawlbase-java-sdk-pom

Java SDK for crawling and scraping with Crawlbase.

Maven →.NETdotnet add package CrawlbaseAPI

Integrate the Crawlbase APIs into .NET projects via NuGet.

NuGet →Gogo get github.com/crawlbase/crawlbase-go

A lean Go client for the Crawling API.

pkg.go.dev →Scrapypip install scrapy-crawlbase-middleware

Crawlbase middleware for your Scrapy spiders.

PyPI →Zapier

Wire Crawlbase into no-code Zapier workflows.

Zapier →Any languagecurl https://api.crawlbase.com

No SDK needed. Call the REST API directly over HTTP from anything.

View the docs →Missing one?

Built a library or want to collaborate? We would love to work with you.

Contact us →
03 How it works

From install to data in four lines.

Easy to deploy, whether you are starting out or running at scale.

01

Choose your language

Node, Python, Ruby, PHP, Java, .NET or Go. Or skip the SDK and use plain HTTP.

02

Install the package

One line from your registry: npm, PyPI, RubyGems, Packagist, Maven, NuGet or go get.

03

Initialize with your token

Create the client with one of your Crawlbase tokens. The same token works everywhere.

04

Call the API

Pass any URL plus parameters like autoparse or screenshot, and read the response.

04 Notes

Good to know.

Free and open

Every SDK and library is free. You only pay for the Crawling API requests you make, and up to 10,000 are free.

Any language over HTTP

No SDK for your stack? The API is a plain REST endpoint, so you can call it directly from anything that speaks HTTP.

Fully documented

Each SDK is covered in the SDK docs, with copy-paste install and usage examples.

One token, every product

The same token and client cover the Crawling API, the Crawler and every scraper. See usage pricing on the pricing page.

05 Why Crawlbase

One client, the whole platform.

The SDKs wrap the same network that serves 70,000+ developers. No proxies to buy, no browsers to run, nothing to patch when a site changes.

7
Official language SDKs
Free
Every library, up to 10,000 free requests
70K+
Developers on the network
1
Token across every product

Install in one line, initialize with your token, and the Crawling API and every scraper are a method call away.

06 FAQ

SDK questions.

Official SDKs for Node, Python, Ruby, PHP, Java, .NET and Go, plus a Scrapy middleware and a Zapier integration. All are free and call the Crawling API and every scraper through one client.
Yes. Every SDK and library is free. You only pay for the Crawling API requests you make, and up to 10,000 are free.
You do not need an SDK. The Crawlbase API is a plain REST endpoint, so you can call it directly over HTTP from any language or tool.
One client covers the Crawling API and the scrapers, with helpers for parameters such as autoparse, screenshots, geotargeting and storage, so you write less boilerplate.
Initialize the client with one of your Crawlbase tokens. The same token works across the SDKs, the Crawling API, the Crawler and every scraper.
Every SDK is documented with copy-paste examples, and our support team is available if you hit an issue or want to contribute a library.

Install the SDK.
Crawl in four lines.

Free to begin, with up to 10,000 free Crawling API requests. One token, every language.

Start freeRead the docs