Docs
Log in
Migrate to the Crawling API with &scraper=name

Same scrapers, simpler endpoint, more parameters. The standalone Scraper API has been closed to new sign-ups since Oct 1, 2024 — existing integrations continue to work, no shutdown is scheduled, and migrating is a one-line URL change.

Endpoint

GEThttps://api.crawlbase.com/scraper?token=YOUR_TOKEN&url=ENCODED_URL&scraper=NAME
# Identical to the Crawling API, plus a required `scraper` parameter.
# Returns parsed JSON instead of raw HTML.

Quickstart — Amazon product

curl 'https://api.crawlbase.com/scraper?token=YOUR_TOKEN' \
  --data-urlencode 'url=https://www.amazon.com/dp/B08N5WRWNW' \
  --data-urlencode 'scraper=amazon-product-details' -G
from crawlbase import ScraperAPI

api = ScraperAPI({'token': 'YOUR_TOKEN'})
res = api.get(
    'https://www.amazon.com/dp/B08N5WRWNW',
    {'scraper': 'amazon-product-details'}
)
import json
data = json.loads(res['body'])
print(data['name'], data['price'])
const { ScraperAPI } = require('crawlbase');
const api = new ScraperAPI({ token: 'YOUR_TOKEN' });

const res = await api.get(
  'https://www.amazon.com/dp/B08N5WRWNW',
  { scraper: 'amazon-product-details' }
);
const data = JSON.parse(res.body);
console.log(data.name, data.price);

Sample response:

{
  "name": "Echo Dot (4th Gen) | Smart speaker with Alexa",
  "asin": "B08N5WRWNW",
  "brand": "Amazon",
  "price": "$49.99",
  "availability": "In Stock",
  "rating": 4.7,
  "reviews_count": 412903,
  "main_image": "https://m.media-amazon.com/images/I/61MZi+B-OBL.jpg",
  "images": ["…"],
  "features": ["Meet the all-new Echo Dot…"],
  "description": "Our most popular smart speaker…"
}

Scraper catalog

A representative slice of the scrapers available. Pass the scraper name as the scraper parameter.

Amazon

ScraperReturns
amazon-product-detailsProduct page: name, price, ratings, images, features
amazon-search-resultsSearch listings page: products, pagination, filters
amazon-reviewsReview page with rating, author, date, body, helpful counts
amazon-bestsellersBest Sellers ranked listings by category
amazon-questionsCustomer Q&A section

Google

ScraperReturns
google-serpSearch results: organic, ads, knowledge panel, related searches
google-shoppingShopping tab listings with merchant, price, rating
google-newsNews tab results with source, snippet, time
google-mapsPlace page: name, address, hours, ratings, reviews
google-scholarAcademic search results with citations

Social networks

ScraperReturns
linkedin-profilePublic profile data: experience, education, skills
linkedin-companyCompany page: size, industry, headquarters
instagram-profileProfile metadata, recent posts, follower counts
tiktok-profileTikTok user profile and recent videos
youtube-channelChannel metadata, subscriber count, recent uploads

Other marketplaces

ScraperReturns
ebay-product-detailseBay listing data
walmart-productWalmart product page
yelp-businessYelp business listing with reviews summary
booking-hotelBooking.com hotel page with rates and amenities
tripadvisor-attractionTripAdvisor attraction page
Don't see what you need?

The full catalog is in your dashboard. New scrapers are added monthly. Email us if you need a custom scraper for a site we don't cover yet.

Auto-detect with autoparse

If you know the URL but don't want to look up the right scraper name, use autoparse=true on the standard Crawling API endpoint. We'll detect the page type and apply the matching scraper automatically.

curl 'https://api.crawlbase.com/?token=YOUR_TOKEN' \
  --data-urlencode 'url=https://www.amazon.com/dp/B08N5WRWNW' \
  --data-urlencode 'autoparse=true' -G

# Crawlbase recognizes the Amazon URL and auto-applies amazon-product-details

Parameters

The Scraper API endpoint accepts the same shape as the Crawling API, narrowed to the five params below plus the scraper name. For deeper notes on each shared param, the Crawling API reference is canonical — this list is the self-contained reference for the legacy /scraper endpoint.

token
stringrequired
Your private Crawlbase token. The Normal token is the default; use the JavaScript token when combined with javascript=true.
url
stringrequired
Target URL to scrape. Must start with http or https and be fully URL-encoded.
scraper
stringrequired
Name of the scraper to apply. See the catalog above for the supported set.
country
ISO 3166optional
Geolocate the request from a specific country (e.g. US, GB, DE). Country availability is plan-gated; full country list lives on the Crawling API parameters reference.
javascript
booleanfalse
Render the page in a real Chrome browser before scraping. Set javascript=true for SPAs and JS-rendered pages. Costs 2 credits per request; requires the JavaScript token, not the Normal token.
premium
booleanfalse
Route the request through Crawlbase's premium residential network for tougher anti-bot targets. Costs 10 credits per request, or 20 credits when combined with javascript=true. Plan-gated.

Scraper-specific errors

CodeMeaning
422Unknown scraper name. Check spelling against the catalog.
423URL doesn't match the scraper's expected pattern (e.g. amazon-product-details on a non-product URL).
425Page structure changed and the scraper couldn't extract data. Reported automatically; usually fixed within hours.