Scraping cookbook · Tech and developer

Scraping tech and developer sites

11 sites in this category, measured on Crawlbase traffic in August 2026. Each page carries the call that works and the numbers behind it.

Search engines and developer platforms, google.com, bing.com, leetcode.com and kaggle.com. Search result pages are the main target, and the recipes name the scraper parameter where Crawlbase returns them as JSON. 8 of the 11 sites answer the plain token. Prices run from 1 credit to 2 credits a page.

google.comTech and developer

97.0% of calls to google.com succeed. search results, no browser needed, median answer 1.9s.

Success · Aug97.0%
BrowserNo
Price2 credits
github.comTech and developer

94.5% of calls to github.com succeed. the homepage, browser only where the pattern needs it, median answer 1.6s.

Success · Aug94.5%
Browser18% of calls
Price1 credit
bing.comTech and developer

How to fetch search results from bing.com: no browser needed, 90.5% success, one call per page.

Success · Aug90.5%
BrowserNo
Price1.5 credits
baidu.comTech and developer

99.9% of calls to baidu.com succeed. search results, no browser needed, median answer 2.3s.

Success · Aug99.9%
BrowserNo
Price1 credit
duckduckgo.comTech and developer

95.9% of calls to duckduckgo.com succeed. pages, no browser needed, median answer 2.1s.

Success · Aug95.9%
BrowserNo
Price1 credit
klaviyo.comTech and developer

How to fetch pages from klaviyo.com: no browser needed, 97.8% success, one call per page.

Success · Aug97.8%
BrowserNo
Price1 credit
leetcode.comTech and developer

Pages on leetcode.com: no browser needed, 100% success in Aug 2026.

Success · Aug100%
BrowserNo
Price1 credit
kaggle.comTech and developer

99.9% of calls to kaggle.com succeed. pages, no browser needed, median answer 903ms.

Success · Aug99.9%
BrowserNo
Price1 credit
ietf.orgTech and developer

95.8% of calls to ietf.org succeed. doc pages, browser only where the pattern needs it, median answer 7.5s.

Success · Aug95.8%
Browser85% of calls
Price1 credit
brave.comTech and developer

Search results on brave.com: no browser needed, 99.6% success in Aug 2026.

Success · Aug99.6%
BrowserNo
Price1 credit
getrecharge.comTech and developer

99.7% of calls to getrecharge.com succeed. docs pages, JavaScript token, median answer 3.7s.

Success · Aug99.7%
BrowserYes
Price1 credit
Site names identify the pages a recipe fetches. Crawlbase is not affiliated with any site listed. Use recipes within the acceptable use policy.Measured numbers from August 2026, refreshed monthly