Scrape product pages on myprotein.com
The call that returns product pages from myprotein.com today, with the parameters, patterns and failure modes read off the request log since 14 Aug 2026. Last tested 6 Sep 2026.
About myprotein.com
myprotein.com describes itself as “Feel empowered with Myprotein. Shop premium supplements and gym & workout clothes from the UK's No.1 sports nutrition brand to support your goals”.
Its home page declares 12 languages: de-at, ro-ro, cs-cz, hu-hu, nb-no, ru-kz, sk-sk, es-es, en-hk, nl-nl, nl-be, sv-se.
Its sitemaps list 3,943 URLs across 9 files (product-0, list-0, department-0, post-sitemap1, post-sitemap2, page-sitemap). 57 of the 1,077 dated entries changed in the last 30 days, the newest on 3 Sep 2026.
Its robots.txt names 4 sitemaps and disallows 12 paths.
Measured on Crawlbase
Success rate over every request from every account in August 2026: 99.7%. Patterns, countries and failures come from the request log since 14 Aug 2026; 59.9% of successful calls used the JavaScript token and the median answer took 14.3s.
Among the 20 sports and outdoor sites in the Cookbook, myprotein.com ranks 7 of 20 by success rate; the category median is 99.2%. Its median answer of 14.3s is slower than the category median of 7.1s. 12 of the 20 accept the plain token; this one does on some pages only.
The call
Product pages are the shape the accounts fetch most here, with the country and token that succeed most often. Replace the placeholder path with a real product URL from the site.
curl "https://api.crawlbase.com/?token=YOUR_TOKEN&url=https%3A%2F%2Fwww.myprotein.com%2Fexample-section%2Fexample-page%2Fexample-page"from crawlbase import CrawlingAPI api = CrawlingAPI({'token': 'YOUR_TOKEN'}) r = api.get('https://www.myprotein.com/example-section/example-page/example-page') html = r['body']
const { CrawlingAPI } = require('crawlbase'); const api = new CrawlingAPI({ token: 'YOUR_TOKEN' }); const r = await api.get('https://www.myprotein.com/example-section/example-page/example-page');
Parameters that matter
| Parameter | Set it to | Why |
|---|---|---|
country | leave unset | Most successful calls set no country (66.7%) and succeed at 100%. |
javascript | leave unset | Plain-token calls succeed at 100% and make up 50.0% of the traffic. A browser costs more and, on this site, buys nothing. |
URL patterns accounts fetch
| Pattern | Share of successes | JavaScript token | Country | Query parameters |
|---|---|---|---|---|
/{slug}/{slug}/{slug} | 75.0% | 0.0% | none | none |
/c/{slug}/{slug} | 25.0% | 100% | none | none |
Fields you get
Structured data Crawlbase found on myprotein.com, by page type. These are the schema.org types in the page, the fields your parser can read straight from the JSON-LD block:
- Home:
WebSite, Organization - Detail page:
Product, SaleEvent, BreadcrumbList - Listing:
CollectionPage, BreadcrumbList - Article:
BreadcrumbList, Organization, WebSite, ImageObject, WebPage, Article, Person - Profile:
BreadcrumbList
What breaks, and the fix
Of the failures since 14 Aug 2026, the site answered:
Run it on a schedule
A catalogue refresh is a list of product URLs. Push it to the Crawler with a callback, let it pace the calls and retry what the site refuses, and read the results from Cloud Storage. The median answer on this site is 14.3s.
Questions
Do I need a browser to scrape myprotein.com?
No. 100% of plain-token calls succeed and accounts send 50.0% of their traffic without a browser.
How much does a myprotein.com page cost on Crawlbase?
1 credit without a browser. myprotein.com is in the standard tier.
Which country should I set for myprotein.com?
None is needed: most successful calls leave it unset.
Other pages on myprotein.com
Pages myprotein.com lists in its own sitemaps, fetched by Crawlbase on 6 Sep 2026 and verified in 2 consecutive runs. Each row is the cheapest call that returned the page with its content.
| Page | Example | Token | Country | Median |
|---|---|---|---|---|
Home/Structured data: WebSite, Organization | myprotein.com/ | Plain | none | 3.2s |
Detail page/p/{slug}/{slug}Structured data: Product, SaleEvent, BreadcrumbList | myprotein.com/p/technology/nutribullet-juicer/17615111/ | Plain | none | 3.2s |
Listing/c/{slug}/{slug}Structured data: CollectionPage, BreadcrumbList | myprotein.com/c/pro/sign-up/ | Plain | none | 2.1s |
Article/{slug}/{slug}/{slug}Structured data: BreadcrumbList, Organization, WebSite, ImageObject, WebPage, Article, Person | none | Plain | none | 9.0s |
Profile/{slug}/author/{slug}Structured data: BreadcrumbList | none | Plain | none | 2.5s |