Scrape product pages on charlottetilbury.com

About charlottetilbury.com

charlottetilbury.com describes itself as “Shop luxury makeup, skincare and fragrance and discover Charlotte's award-winning collection of beauty products and online exclusives”.

Its home page declares 12 languages: de-de, en-hk, fr-fr, fr-ca, en-gb, en-je, en-gg, en-im, en-ie, en-us, en-ca, es-us.

Its sitemaps list 39,928 URLs across 14 files (uk_sitemap, us_sitemap, us-es_sitemap, eu_sitemap, ie_sitemap, es_sitemap). 2,596 of the 39,928 dated entries changed in the last 30 days, the newest on 6 Sep 2026.

Its robots.txt names 14 sitemaps and disallows 12 paths.

Measured on Crawlbase

Success rate over every request from every account in August 2026: 99.9%. Patterns, countries and failures come from the request log since 14 Aug 2026; 0.1% of successful calls used the JavaScript token and the median answer took 1.1s.

Among the 23 beauty sites in the Cookbook, charlottetilbury.com ranks 1 of 23 by success rate; the category median is 95.6%. Its median answer of 1.1s is faster than the category median of 2.3s. 17 of the 23 accept the plain token, this one among them.

The call

Product pages are the shape the accounts fetch most here, with the country and token that succeed most often. Replace the placeholder path with a real product URL from the site.

curl "https://api.crawlbase.com/?token=YOUR_TOKEN&url=https%3A%2F%2Fwww.charlottetilbury.com%2Fus-es%2Fproduct%2Fwonderglow"

from crawlbase import CrawlingAPI
api = CrawlingAPI({'token': 'YOUR_TOKEN'})

r = api.get('https://www.charlottetilbury.com/us-es/product/wonderglow')
html = r['body']

const { CrawlingAPI } = require('crawlbase');
const api = new CrawlingAPI({ token: 'YOUR_TOKEN' });

const r = await api.get('https://www.charlottetilbury.com/us-es/product/wonderglow');

Parameters that matter

URL patterns accounts fetch

Fields you get

A product page usually carries an ld+json Product block with name, price, currency and availability, and the same values in the visible markup. Read the block first; it changes less often than the layout.

What breaks, and the fix

Of the failures since 14 Aug 2026, the site answered:

Run it on a schedule

A catalogue refresh is a list of product URLs. Push it to the Crawler with a callback, let it pace the calls and retry what the site refuses, and read the results from Cloud Storage. The median answer on this site is 1.1s.

Questions

Other pages on charlottetilbury.com

Pages charlottetilbury.com lists in its own sitemaps, fetched by Crawlbase on 6 Sep 2026 and verified in 2 consecutive runs. Each row is the cheapest call that returned the page with its content.