crawling API FAQs

At the moment the only way to use Crawlbase is by integrating it to your product or service, therefore you will need to know development or know/pay someone which can help you.

Please note that we have some very easy to integrate libraries.

We want to offer more than just a list or lists of proxies, therefore our API and Crawler products are built on top of thousands of residential and datacenter worldwide proxies combined with artificial intelligence plus our engineering team which helps delivering the best data results possible. If you are looking just for proxies and you don't want to get any of the other benefits, we recommend that you use the Smart Proxy

We don't provide the number of proxies as it's constantly changing.

Our team of network experts are constantly looking for new worldwide proxies and replacing fault ones, plus our artificial inteligence might use a smaller or bigger set of proxies depending on the site you are trying to crawl.

If you are a proxy provider or have proxies to sell, please contact us as we are constantly growing our infrastructure.

Yes they do rotate on every request with a new IP. If you don't want that, you can use sessions, take a look at sessions here.

We try our best to support every website. Please contact us to see how we can help.

No, all the Crawling API calls have unlimited bandwidth.

Yes you can use the free requests for javaScript or normal requests.