Solutions / eCommerceCrawl and scrape
Crawl and scrape
eCommerce data.
Scrape eCommerce sites like Amazon, eBay, AliExpress and Walmart with the Crawlbase Crawling API. Extract trending products, prices, reviews and best-seller insights, with no blocks to manage.
01 In short
What is eCommerce scraping with Crawlbase?
eCommerce scraping with Crawlbase means sending a product, search or category URL to the Crawling API and getting the page back as rendered HTML or as parsed JSON. Crawlbase handles the proxies, JavaScript rendering and CAPTCHAs, so you only deal with the data.
For Amazon, Walmart, eBay, AliExpress, Galaxus, Best Buy, Google Shopping, TikTok Shop and OLX, add a scraper name such as amazon-product-details to the request and the response comes back as structured JSON. For any other store, the same call returns the full HTML for you to parse. You can start free with up to 5,000 requests and no credit card.
02 Crawl and scrape sites
Scrape the eCommerce sites you sell on.
Product descriptions, prices, seller info, ratings and more, across the marketplaces that matter.
AmazonScrapereBayScraperWalmartScraperAliExpressScraperBest BuyScraperTargetScraperFlipkartScraperAlibabaScraper
Crawlbase supports these and many other eCommerce pages.
03 Scraper catalog
Ready-made eCommerce scrapers.
Each scraper targets one page type, so the JSON shape stays stable. Pass its name in the scraper parameter of a Crawling API call. Input formats and output schemas are in the docs.
amazon-product-details · amazon-serp · amazon-offer-listing · amazon-product-reviews · amazon-best-sellers · amazon-new-releases
Amazon
Product details, search results, offer listings from every seller, product reviews, and the Best Sellers and New Releases charts. Pass country (for example US, UK or DE) to hit a regional storefront.
walmart-product-details · walmart-serp · walmart-category
Walmart
Product pages, search results and department or category feeds. Useful for tracking price parity between Amazon and Walmart for the same item.
ebay-product · ebay-serp · ebay-seller-shop
eBay
Listings with price, seller, condition and shipping, search results, and every listing in a single seller's shop.
aliexpress-product · aliexpress-serp
AliExpress
Product pages and search results. Pair with country to see the localized price and shipping for the buyer market you care about.
galaxus-product · galaxus-serp · galaxus-product-reviews
Galaxus
Product pages, search results and customer reviews for Galaxus and Digitec in Switzerland. Set country to CH for accurate pricing and availability.
bestbuy-product-details · bestbuy-serp
Best Buy
Product details and search results. A strong fit for consumer electronics price tracking in North America.
google-product-offers
Google Shopping
All merchant offers for a Google Shopping product, with prices, ratings and seller info. A cross-retailer price comparison without scraping each store.
tiktok-shop
TikTok Shop
A TikTok Shop storefront: store metadata, products, ratings and follower counts. Works best with your JavaScript token.
olx-serp · olx-item
OLX
Search or category results and single ad pages on the shared OLX frontend: olx.pl, olx.ua, olx.pt, olx.ro, olx.bg, olx.kz and olx.uz.
04 What you can scrape
Structured data, ready to use.
Product details
- Product titles
- Descriptions
- Images
- Categories
Market insights
- Customer reviews
- Seller information
- Trending products
- Discounts and deals
Logistics data
- Product availability
- Delivery time
- Shipping cost
- Shipping method
05 How it works
From URL to JSON in four steps.
The same flow works for every marketplace in the catalog.
01
Get a token
Create a free Crawlbase account and copy your Crawling API token.
02
Pick a scraper
Choose the scraper that matches the page type: product, search, category, seller shop, offers or reviews.
03
Send the URL
Call the Crawling API with your token, the target URL and the scraper name. Add country when you need a specific storefront.
04
Get JSON back
Crawlbase routes the request, renders the page, clears bot checks and returns parsed JSON. Only successful requests are billed.
06 See it work
One GET request, structured data back.
Point the Crawling API at an Amazon product or search URL and get the rendered page or autoparsed JSON. No proxies, no CAPTCHAs.
curl "https://api.crawlbase.com/?token=YOUR_TOKEN&scraper=amazon-product-details\
&url=https://www.amazon.com/dp/B07S5QWM6L"07 Code sample
The same call from Python.
Install the official SDK with pip install crawlbase, then pass the scraper name as an option. SDKs are also available for Node.js, Ruby, PHP, Go, Java and .NET.
from crawlbase import CrawlingAPI
import json
api = CrawlingAPI({'token': 'YOUR_TOKEN'})
res = api.get(
'https://www.amazon.com/Apple-iPhone-Silicone-Case-MagSafe/dp/B0CHX2XFLN',
{'scraper': 'amazon-product-details'}
)
data = json.loads(res['body'])
print(data['name'], data['price'])08 Use cases
What teams build with eCommerce data.
USE / 01Pricing
Price monitoring
Poll amazon-product-details or walmart-product-details on a schedule, store price and availability, and alert when either changes.
USE / 02Competition
Competitive intelligence
Run amazon-serp for your target queries, then fetch product details for each result to see who ranks and at what price.
USE / 03Catalog
Catalog enrichment
Fill gaps in your own SKUs with brand, images, features and descriptions from the product detail scrapers.
USE / 04Marketing
Launch and ad measurement
Track amazon-best-sellers and amazon-new-releases rankings before and after a campaign or product launch.
USE / 05Sellers
Reseller tracking
Use ebay-seller-shop to follow a specific seller's catalog over time instead of a fixed product.
USE / 06Reviews
Review analysis
Pull amazon-product-reviews or galaxus-product-reviews to track ratings and recurring complaints for your products and your competitors' products.
09 Why teams choose Crawlbase
Built for accurate eCommerce data at scale.
- Great support and docs
- Seamless scaling capability
- Accurate and consistent eCommerce data
- No limits, global proxies to access any site
- GDPR and CCPA compliant
- Easily access blocked content
10 All in one platform
Collect, store and scale.
Crawling API
Get the full rendered HTML or autoparsed JSON for any product or search page. Rotating proxies and AI clear IP blocks and CAPTCHAs from any geo-location.
Cloud Storage
Send crawled pages straight to the cloud with a single parameter, so you do not stand up storage yourself.
Crawler
For huge projects, run asynchronous crawling with callbacks to save cost, retries and bandwidth.
11 Overview
Crawlbase for eCommerce crawling.
Easy to use, even with limited coding knowledge.
Highly scalable API using our worldwide proxies.
Automate browser scraping for JavaScript-heavy sites.
Protect your crawler from blocks, IP leaks and CAPTCHAs.
Export data as raw HTML or structured JSON.
Fetch fast, reliable and high-quality data.
12 Good to know
Before you start.
Sites without a scraper
For stores not in the catalog, call the Crawling API without the scraper parameter and parse the returned HTML yourself.
Regional storefronts
Pass country (for example DE) to see what a local shopper sees: currency, locale and regional availability.
One token for everything
The same token works for every scraper and for plain Crawling API calls, with the same rate limits. There is no per-site setup.
Stable output
Each scraper targets a single page type, so the JSON shape stays stable when the underlying HTML changes.
13 FAQ
eCommerce scraping questions.
For sites like Amazon, eBay, AliExpress, Walmart and Best Buy you can export data as CSV, Excel or JSON. For other eCommerce sites the default output is HTML. Need another format? Contact support for custom solutions.
Yes. Our support team is available 24/7 to help with any issue or question.
The Crawling API responds in about 4 to 10 seconds on average. We recommend setting a timeout of at least 90 seconds.
Amazon, Walmart, eBay, AliExpress, Galaxus, Best Buy, Google Shopping (product offers), TikTok Shop and OLX. The scrapers cover page types such as product details, search results, category feeds, seller shops, offer listings and reviews.
Yes. Send the URL to the Crawling API without the scraper parameter and you get the full page HTML back, with proxies, rendering and CAPTCHAs handled. You then parse the fields you need.
Add the country parameter to the request, for example country=DE. Crawlbase routes the request so you see the currency, locale and availability that a shopper in that country sees.
No. The Crawling API rotates proxies, renders JavaScript when needed and handles CAPTCHAs and blocks for you.
You can start free with up to 5,000 requests and no credit card. After that you pay only for successful requests, and one token works across every scraper and the Crawling API. See the pricing page for current rates.
Start scraping eCommerce.
Skip the blocks.
Up to 5,000 requests free, no credit card. One API for every marketplace, with no proxies or CAPTCHAs to manage.