Cookbook·Marketplaces·amazon.com
Scrape product pages on amazon.com
The call that returns product pages from amazon.com today, with the parameters, patterns and failure modes read off the request log since 14 Aug 2026. Last tested 6 Sep 2026.
98.2% success · Aug 2026Browser on 9% of callsModerate price · 1.5 credits
About amazon.com
amazon.com describes itself as “Free shipping on millions of items. Get the best of Shopping and Entertainment with Prime. Enjoy low prices and great deals on the largest selection of everyday essentials and other products, including fashion, home, beauty, electronics, Alexa Devices, sporting goods, toys, automotive, pets, baby,…”.
Its robots.txt disallows 12 paths.
Measured on Crawlbase
Success rate over every request from every account in August 2026: 98.2%. Patterns, countries and failures come from the request log since 14 Aug 2026; 8.8% of successful calls used the JavaScript token and the median answer took 3.4s.
Among the 16 marketplaces sites in the Cookbook, amazon.com ranks 12 of 16 by success rate; the category median is 99.6%. Its median answer of 3.4s is faster than the category median of 7.1s. 7 of the 16 accept the plain token; this one does on some pages only.
The call
Product pages are the shape the accounts fetch most here, with the country and token that succeed most often. Replace the placeholder path with a real product URL from the site.
curl "https://api.crawlbase.com/?token=YOUR_TOKEN&url=https%3A%2F%2Fwww.amazon.com%2Fdp%2Fexample-page"from crawlbase import CrawlingAPI api = CrawlingAPI({'token': 'YOUR_TOKEN'}) r = api.get('https://www.amazon.com/dp/example-page') html = r['body']
const { CrawlingAPI } = require('crawlbase'); const api = new CrawlingAPI({ token: 'YOUR_TOKEN' }); const r = await api.get('https://www.amazon.com/dp/example-page');
Parameters that matter
| Parameter | Set it to | Why |
|---|---|---|
country | leave unset | Most successful calls set no country (68.3%) and succeed at 98.5%. |
javascript | leave unset | Plain-token calls succeed at 98.4% and make up 92.9% of the traffic. A browser costs more and, on this site, buys nothing. |
URL patterns accounts fetch
| Pattern | Share of successes | JavaScript token | Country | Query parameters |
|---|---|---|---|---|
/dp/{slug} | 41.8% | 10.2% | US | psc, th, s |
/s | 24.0% | 11.5% | none | k, page, language |
/sp | 17.5% | 0.0% | none | ie, seller, asin |
/gp/product/{slug} | 10.5% | 0.0% | none | asin, m, qid |
/dp/product/{slug} | 4.8% | 21.1% | none | psc, language |
Fields you get
Structured data Crawlbase found on amazon.com, by page type. These are the schema.org types in the page, the fields your parser can read straight from the JSON-LD block:
- Other:
WebSite
What breaks, and the fix
Of the failures since 14 Aug 2026, the site answered:
504: 45.7% of failures A 504 is a timeout: the page did not finish inside the limit. Retry once, and keep your own client timeout above the median answer time shown for this site.
200: 6.8% of failures The site answered 200 with a block or consent page instead of the content, and Crawlbase counted it as a failure rather than bill you for it. Retry once with the JavaScript token and the country the successful calls use.
0: 6.7% of failures A status of 0 is a request that never got an answer inside the timeout. Retry once with the JavaScript token if the pattern needs a browser.
517, 503: 30.8% of failures together A 5xx is the site failing, not the fetch. Retry after a minute.
Run it on a schedule
A catalogue refresh is a list of product URLs. Push it to the Crawler with a callback, let it pace the calls and retry what the site refuses, and read the results from Cloud Storage. The median answer on this site is 3.4s.
Questions
Do I need a browser to scrape amazon.com?
No. 98.4% of plain-token calls succeed and accounts send 92.9% of their traffic without a browser.
How much does a amazon.com page cost on Crawlbase?
1.5 credits without a browser. amazon.com is in the moderate tier.
Which country should I set for amazon.com?
None is needed: most successful calls leave it unset.
Other pages on amazon.com
Pages amazon.com lists in its own sitemaps, fetched by Crawlbase on 6 Sep 2026 and verified in 2 consecutive runs. Each row is the cheapest call that returned the page with its content.
| Page | Example | Token | Country | Median |
|---|---|---|---|---|
Home/ | amazon.com/ | Plain | none | 2.3s |
Detail page/{slug}/dp/{slug} | none | Plain | none | 4.7s |
Listing/deals | amazon.com/deals | Plain | none | 4.0s |
Other/{slug}/{slug}Structured data: WebSite | none | JavaScript | none | 7.3s |
Site names identify the pages a recipe fetches. Crawlbase is not affiliated with any site listed. Use recipes within the acceptable use policy.Measured numbers from August 2026, refreshed monthly