Cookbook·Industrial supply·airproducts.com
Scrape company pages on airproducts.com
The call that returns company pages from airproducts.com today, with the parameters, patterns and failure modes read off the request log since 14 Aug 2026. Last tested 6 Sep 2026.
93.8% success · Aug 2026Browser on 27% of callsStandard price · 1 credit
About airproducts.com
airproducts.com describes itself as “Air Products provide essential industrial gases, related equipment and applications expertise to customers in dozens of industries. Find out more”.
Its sitemaps list 1,174 URLs across 1 file. 16 of the 1,174 dated entries changed in the last 30 days, the newest on 4 Sep 2026.
Its robots.txt names 1 sitemap and disallows 3 paths, among them /sitecore, /sitecore/, /login.
Measured on Crawlbase
Success rate over every request from every account in August 2026: 93.8%. Patterns, countries and failures come from the request log since 14 Aug 2026; 27.4% of successful calls used the JavaScript token and the median answer took 3.9s.
Among the 15 industrial supply sites in the Cookbook, airproducts.com ranks 13 of 15 by success rate; the category median is 97.5%. Its median answer of 3.9s is slower than the category median of 1.8s. 9 of the 15 accept the plain token; this one does on some pages only.
The call
Product pages are the shape the accounts fetch most here, with the country and token that succeed most often. Replace the placeholder path with a real product URL from the site.
curl "https://api.crawlbase.com/?token=YOUR_TOKEN&country=US&url=https%3A%2F%2Fwww.airproducts.com%2Fcompany%2Fexample-section%2Fexample-page"from crawlbase import CrawlingAPI api = CrawlingAPI({'token': 'YOUR_TOKEN'}) r = api.get('https://www.airproducts.com/company/example-section/example-page', {'country': 'US'}) html = r['body']
const { CrawlingAPI } = require('crawlbase'); const api = new CrawlingAPI({ token: 'YOUR_TOKEN' }); const r = await api.get('https://www.airproducts.com/company/example-section/example-page', { country: 'US' });
Parameters that matter
| Parameter | Set it to | Why |
|---|---|---|
country | US | 56.2% of successful calls set it and they succeed at 91.4%; calls without a country succeed at 98.7%. |
javascript | leave unset | Plain-token calls succeed at 98.7%, JavaScript-token calls at 90.2%. Both work; start without the browser and switch per URL pattern where the table below shows it. |
URL patterns accounts fetch
| Pattern | Share of successes | JavaScript token | Country | Query parameters |
|---|---|---|---|---|
/company/{slug}/{slug} | 73.5% | 74.5% | US | rssfeed, _id, _z |
/company/{slug} | 6.5% | 100% | US | none |
/company/{slug}/{id} | 6.3% | 100% | US | none |
Fields you get
Structured data Crawlbase found on airproducts.com, by page type. These are the schema.org types in the page, the fields your parser can read straight from the JSON-LD block:
- Home:
Organization - Other:
Article
What breaks, and the fix
Of the failures since 14 Aug 2026, the site answered:
202: 29.1% of failures 202 means the site refused the fetch. Treat it like a block: retry once with the JavaScript token and the country the successful calls use, then stop.
403: 18.1% of failures A 403 is the site refusing the exit. Set the country the successful calls use and retry once; a second 403 means the URL itself is protected.
500, 591, 529: 45.7% of failures together A 5xx is the site failing, not the fetch. Retry after a minute.
Run it on a schedule
A catalogue refresh is a list of product URLs. Push it to the Crawler with a callback, let it pace the calls and retry what the site refuses, and read the results from Cloud Storage. The median answer on this site is 3.9s.
Questions
Do I need a browser to scrape airproducts.com?
It depends on the page. Plain-token calls succeed at 98.7%, JavaScript-token calls at 90.2%; the URL pattern table shows which paths accounts fetch with a browser.
How much does a airproducts.com page cost on Crawlbase?
1 credit without a browser. airproducts.com is in the standard tier.
Which country should I set for airproducts.com?
US: that is what 56.2% of successful calls use.
Other pages on airproducts.com
Pages airproducts.com lists in its own sitemaps, fetched by Crawlbase on 6 Sep 2026 and verified in 2 consecutive runs. Each row is the cheapest call that returned the page with its content.
| Page | Example | Token | Country | Median |
|---|---|---|---|---|
Home/Structured data: Organization | airproducts.com/ | Plain | none | 2.1s |
Other/{slug}/{slug}/{id}Structured data: Article | none | Plain | none | 2.2s |
Site names identify the pages a recipe fetches. Crawlbase is not affiliated with any site listed. Use recipes within the acceptable use policy.Measured numbers from August 2026, refreshed monthly