Scraping cookbook · Beauty

Scraping beauty sites

23 sites in this category, measured on Crawlbase traffic in August 2026. Each page carries the call that works and the numbers behind it.

Beauty and fragrance retailers, led by sephora.com and the French chains marionnaud.fr and nocibe.fr. Product pages with shades, sizes and prices are the common shape, and most answer the plain token. 17 of the 23 sites answer the plain token. Prices run from 1 credit to 1.5 credits a page.

sephora.comBeauty

Working call, parameters that matter, the fields you get and what breaks.

Success · Aug99.7%
BrowserNo
Price1 credit
esteelauder.comBeauty

95.7% of calls to esteelauder.com succeed. product pages, no browser needed, median answer 1.4s.

Success · Aug95.7%
BrowserNo
Price1 credit
nocibe.frBeauty

Product pages on nocibe.fr: no browser needed, FR exit, 94.2% success in Aug 2026.

Success · Aug94.2%
BrowserNo
Price1 credit
jomalone.comBeauty

97.0% of calls to jomalone.com succeed. product pages, no browser needed, median answer 1.6s.

Success · Aug97.0%
BrowserNo
Price1 credit
ulta.comBeauty

Brand pages on ulta.com: JavaScript token, 99.7% success in Aug 2026.

Success · Aug99.7%
BrowserYes
Price1 credit
clinique.comBeauty

Product pages on clinique.com: no browser needed, 95.2% success in Aug 2026.

Success · Aug95.2%
BrowserNo
Price1 credit
rituals.comBeauty

99.8% of calls to rituals.com succeed. product pages, browser only where the pattern needs it, median answer 7.7s.

Success · Aug99.8%
Browser51% of calls
Price1 credit
clarins.comBeauty

90.9% of calls to clarins.com succeed. product pages, no browser needed, median answer 1.2s.

Success · Aug90.9%
BrowserNo
Price1 credit
shiseido.comBeauty

98.8% of calls to shiseido.com succeed. product pages, no browser needed, median answer 1.8s.

Success · Aug98.8%
Browser12% of calls
Price1 credit
cremedelamer.comBeauty

Product pages on cremedelamer.com: no browser needed, 93.0% success in Aug 2026.

Success · Aug93.0%
Browser10% of calls
Price1 credit
cosmoprofbeauty.comBeauty

How to fetch product pages from cosmoprofbeauty.com: no browser needed, 92.2% success, one call per page.

Success · Aug92.2%
BrowserNo
Price1.5 credits
benefitcosmetics.comBeauty

How to fetch product pages from benefitcosmetics.com: no browser needed, 92.5% success, one call per page.

Success · Aug92.5%
BrowserNo
Price1 credit
bathandbodyworks.comBeauty

How to fetch pages pages from bathandbodyworks.com: no browser needed, 97.8% success, one call per page.

Success · Aug97.8%
BrowserNo
Price1 credit
marionnaud.frBeauty

How to fetch product pages from marionnaud.fr: browser only where the pattern needs it, 93.4% success, one call per page.

Success · Aug93.4%
Browser33% of calls
Price1 credit
charlottetilbury.comBeauty

How to fetch product pages from charlottetilbury.com: no browser needed, 99.9% success, one call per page.

Success · Aug99.9%
BrowserNo
Price1 credit
diptyqueparis.comBeauty

Product pages on diptyqueparis.com: no browser needed, 99.5% success in Aug 2026.

Success · Aug99.5%
BrowserNo
Price1 credit
mueller.deBeauty

How to fetch product pages from mueller.de: JavaScript token, 95.6% success, one call per page.

Success · Aug95.6%
BrowserYes
Price1 credit
maccosmetics.comBeauty

Product pages on maccosmetics.com: no browser needed, 95.4% success in Aug 2026.

Success · Aug95.4%
BrowserNo
Price1 credit
toofaced.comBeauty

Product pages on toofaced.com: no browser needed, 95.0% success in Aug 2026.

Success · Aug95.0%
BrowserNo
Price1 credit
kalista-parfums.comBeauty

How to fetch product pages from kalista-parfums.com: no browser needed, 92.0% success, one call per page.

Success · Aug92.0%
BrowserNo
Price1 credit
perfecthair.chBeauty

96.0% of calls to perfecthair.ch succeed. product pages, no browser needed, median answer 1.6s.

Success · Aug96.0%
BrowserNo
Price1 credit
lamer.comBeauty

94.0% of calls to lamer.com succeed. product pages, no browser needed, median answer 3.3s.

Success · Aug94.0%
BrowserNo
Price1 credit
clarinsusa.comBeauty

Product pages on clarinsusa.com: no browser needed, US exit, 99.9% success in Aug 2026.

Success · Aug99.9%
BrowserNo
Price1 credit
Site names identify the pages a recipe fetches. Crawlbase is not affiliated with any site listed. Use recipes within the acceptable use policy.Measured numbers from August 2026, refreshed monthly