Cookbook·Home improvement·wayfair.com
Scrape product pages on wayfair.com
The call that returns product pages from wayfair.com today, with the parameters, patterns and failure modes read off the request log since 14 Aug 2026.
96.7% success · Aug 2026No browser neededComplex II price · 4.5 credits
Measured on Crawlbase
Success rate over every request from every account in August 2026: 96.7%. Patterns, countries and failures come from the request log since 14 Aug 2026; 0.0% of successful calls used the JavaScript token and the median answer took 2.8s.
Among the 17 home improvement sites in the Cookbook, wayfair.com sits at 10 of 17 by success rate; the category median is 97.5%. Its median answer of 2.8s is slower than the category median of 2.0s. 11 of the 17 accept the plain token, this one among them.
The call
Product pages are the shape the accounts fetch most here, with the country and token that succeed most often. Replace the placeholder path with a real product URL from the site.
curl "https://api.crawlbase.com/?token=YOUR_TOKEN&country=US&url=https%3A%2F%2Fwww.wayfair.com%2Fexample-page%2Fexample-page%2Fexample-page"from crawlbase import CrawlingAPI api = CrawlingAPI({'token': 'YOUR_TOKEN'}) r = api.get('https://www.wayfair.com/example-page/example-page/example-page', {'country': 'US'}) html = r['body']
const { CrawlingAPI } = require('crawlbase'); const api = new CrawlingAPI({ token: 'YOUR_TOKEN' }); const r = await api.get('https://www.wayfair.com/example-page/example-page/example-page', { country: 'US' });
Parameters that matter
| Parameter | Set it to | Why |
|---|---|---|
country | US | 99.8% of successful calls set it and they succeed at 97.7%; calls without a country succeed at 86.8%. |
javascript | leave unset | Plain-token calls succeed at 97.6% and make up 100% of the traffic. A browser costs more and, on this site, buys nothing. |
URL patterns accounts fetch
| Pattern | Share of successes | JavaScript token | Country | Query parameters |
|---|---|---|---|---|
/{slug}/{slug}/{slug} | 36.9% | 0.0% | US | piid, categoryid |
/home-improvement/{slug}/{slug} | 29.5% | 0.0% | US | piid, categoryid |
/storage-organization/{slug}/{slug} | 13.0% | 0.0% | US | piid, categoryid |
/outdoor/{slug}/{slug} | 8.3% | 0.0% | US | piid, categoryid |
Fields you get
A product page usually carries an ld+json Product block with name, price, currency and availability, and the same values in the visible markup. Read the block first; it changes less often than the layout.
What breaks, and the fix
Of the failures since 14 Aug 2026, the site answered:
429: 67.5% of failures A 429 is a rate limit on the site side. Space the calls or push them to the Crawler, which paces them.
0: 17.2% of failures A status of 0 is a request that never got an answer inside the timeout. Retry once with the JavaScript token if the pattern needs a browser.
591: 9.6% of failures A 5xx is the site failing, not the fetch. Retry after a minute.
Run it on a schedule
A catalogue refresh is a list of product URLs. Push it to the Crawler with a callback, let it pace the calls and retry what the site refuses, and read the results from Cloud Storage. The median answer on this site is 2.8s.
Questions
Do I need a browser to scrape wayfair.com?
No. 97.6% of plain-token calls succeed and accounts send 100% of their traffic without a browser.
How much does a wayfair.com page cost on Crawlbase?
4.5 credits without a browser. wayfair.com is in the complex ii tier.
Which country should I set for wayfair.com?
US: that is what 99.8% of successful calls use.
Site names identify the pages a recipe fetches. Crawlbase is not affiliated with any site listed. Use recipes within the acceptable use policy.Measured numbers from August 2026, refreshed monthly