Scrape category pages on walgreens.com

Measured on Crawlbase

Success rate over every request from every account in August 2026: 91.5%. Patterns, countries and failures come from the request log since 14 Aug 2026; 98.7% of successful calls used the JavaScript token and the median answer took 11.6s.

Among the 6 pharmacy sites in the Cookbook, walgreens.com sits at 6 of 6 by success rate; the category median is 95.2%. Its median answer of 11.6s is slower than the category median of 5.1s. 4 of the 6 accept the plain token; this one needs the JavaScript token.

The call

Category and listing pages are the shape the accounts fetch most here, with the country and token that succeed most often. Replace the placeholder path with a real section URL from the site.

curl "https://api.crawlbase.com/?token=YOUR_JS_TOKEN&country=US&url=https%3A%2F%2Fwww.walgreens.com%2Fstore%2Fc%2Fexample-page"

from crawlbase import CrawlingAPI
api = CrawlingAPI({'token': 'YOUR_JS_TOKEN'})

r = api.get('https://www.walgreens.com/store/c/example-page', {'country': 'US'})
html = r['body']

const { CrawlingAPI } = require('crawlbase');
const api = new CrawlingAPI({ token: 'YOUR_JS_TOKEN' });

const r = await api.get('https://www.walgreens.com/store/c/example-page', { country: 'US' });

Parameters that matter

URL patterns accounts fetch

Fields you get

A listing page carries the items of one section, each with a title, a link and often a price, plus the pagination. The detail lives on the item page; fetch it only for the items you need.

What breaks, and the fix

Of the failures since 14 Aug 2026, the site answered:

Run it on a schedule

Walk the listings on a cadence to find new items, then push the item URLs to the Crawler with a callback; it paces the calls and retries what the site refuses. The median answer on this site is 11.6s.

Questions