Cookbook·Beauty·shiseido.com

Scrape product pages on shiseido.com

The call that returns product pages from shiseido.com today, with the parameters, patterns and failure modes read off the request log since 14 Aug 2026. Last tested 6 Sep 2026.

98.8% success · Aug 2026Browser on 12% of callsStandard price · 1 credit

About shiseido.com

shiseido.com describes itself as “Shiseido, a Japanese Beauty leader for over 150 years, offers revolutionary beauty products in skincare, suncare and makeup. Discover timeless J-Beauty traditions”.

Its home page declares 12 languages: pt-br, en-ca, fr-ca, en-us, es-us, zh-us, fr-fr, de-de, it-it, es-es, en-gb, zh-cn.

Its sitemaps list 1,612 URLs across 17 files (0-product, 1-image, 2-category, 3-content, 4-folder). 400 of the 1,069 dated entries changed in the last 30 days, the newest on 31 Aug 2026.

Its robots.txt names 10 sitemaps and disallows 12 paths.

Measured on Crawlbase

Success rate over every request from every account in August 2026: 98.8%. Patterns, countries and failures come from the request log since 14 Aug 2026; 11.7% of successful calls used the JavaScript token and the median answer took 1.8s.

Among the 23 beauty sites in the Cookbook, shiseido.com ranks 7 of 23 by success rate; the category median is 95.6%. Its median answer of 1.8s is faster than the category median of 2.3s. 17 of the 23 accept the plain token; this one does on some pages only.

The call

Product pages are the shape the accounts fetch most here, with the country and token that succeed most often. Replace the placeholder path with a real product URL from the site.

Run in Playground
curl "https://api.crawlbase.com/?token=YOUR_TOKEN&url=https%3A%2F%2Fwww.shiseido.com%2Fus%2Fen%2Fterms.html"

Parameters that matter

ParameterSet it toWhy
countryleave unsetMost successful calls set no country (99.3%) and succeed at 99.8%.
javascriptleave unsetPlain-token calls succeed at 100% and make up 93.7% of the traffic. A browser costs more and, on this site, buys nothing.

URL patterns accounts fetch

PatternShare of successesJavaScript tokenCountryQuery parameters
/it/{slug}/{slug}80.3%0.0%nonenone
/us/{slug}/{slug}14.8%0.0%nonenone
/on/{slug}/{slug}4.8%0.0%nonepid, dwvar_10122449301SHI_size, dwvar_10121229301SHI_size

Fields you get

Structured data Crawlbase found on shiseido.com, by page type. These are the schema.org types in the page, the fields your parser can read straight from the JSON-LD block:

  • Home: Organization, WebSite, WebPage
  • Detail page: BreadcrumbList, Product
  • Listing: BreadcrumbList

What breaks, and the fix

Of the failures since 14 Aug 2026, the site answered:

999: 32.0% of failures 999 means the site refused the fetch. Treat it like a block: retry once with the JavaScript token and the country the successful calls use, then stop.
504: 24.0% of failures A 504 is a timeout: the page did not finish inside the limit. Retry once, and keep your own client timeout above the median answer time shown for this site.
591, 517, 529: 38.0% of failures together A 5xx is the site failing, not the fetch. Retry after a minute.

Run it on a schedule

A catalogue refresh is a list of product URLs. Push it to the Crawler with a callback, let it pace the calls and retry what the site refuses, and read the results from Cloud Storage. The median answer on this site is 1.8s.

Questions

Do I need a browser to scrape shiseido.com?

No. 100% of plain-token calls succeed and accounts send 93.7% of their traffic without a browser.

How much does a shiseido.com page cost on Crawlbase?

1 credit without a browser. shiseido.com is in the standard tier.

Which country should I set for shiseido.com?

None is needed: most successful calls leave it unset.

Other pages on shiseido.com

Pages shiseido.com lists in its own sitemaps, fetched by Crawlbase on 6 Sep 2026 and verified in 2 consecutive runs. Each row is the cheapest call that returned the page with its content.

PageExampleTokenCountryMedian
Home
/
Structured data: Organization, WebSite, WebPage
shiseido.com/Plainnone4.1s
Detail page
/us/{slug}/{slug}
Structured data: BreadcrumbList, Product
shiseido.com/us/en/crystal-gelgloss-0730852148239.htmlPlainnone2.0s
Listing
/us/{slug}/{slug}
Structured data: BreadcrumbList
shiseido.com/us/en/hsa-fsa/Plainnone2.1s
Other
/us/{slug}/{slug}
shiseido.com/us/en/terms.htmlPlainnone2.1s
Site names identify the pages a recipe fetches. Crawlbase is not affiliated with any site listed. Use recipes within the acceptable use policy.Measured numbers from August 2026, refreshed monthly