Store. Search. Scale
Cloud storage on demand
Start saving results in Crawlbase Storage and store up to
10,000 documents per 14 days for free
Easy to use API
Use the Storage API to retrieve saved pages and screenshots and do full-text search on the pages you are crawling.
Scrape and crawl
We provide tools to scrape and crawl any website while being anonymous and bypass any restriction, blocks or captchas.
Storage comes as a free solution for developers and a very inexpensive solution for companies.
Are you using Amazon AWS S3 or SQS to temporarily or permanently store your crawled pages?
Do you maintain your own database? Searching your crawled data is becoming a problem the more you scale up your web scraping requests?
Crawlbase Storage is a cloud scalable storage solution where you can permanently or temporarily store your HTML pages, screenshots and scraped data.
Storage handles scaling, backing up and cleaning of your cloud space so you can focus on what really matters for your business.
How it Works
Save the RID that will be generated in the API response
Use the RID to retrieve the crawled data from the cloud. Send a GET request to the Storage API or use the Storage dashboard
Example Storage API call using cURL: curl "https://api.crawlbase.com/storage?token=USER_TOKEN_&rid=RID"
Support with a team of experts
Happy customer stories
Stefan WagnerFull stack Dev
The Storage API is our strategic storage platform that allows our team to securely access data and collaborate from any location. It is a great help to maintain smooth business operation.April, 2022
Terrence HuangProduct specialist
A very convenient way to store scraped content. We can share documents quickly, easily, and maintenance-free.Mar, 2022
Cho NoguchiData Scientist
Thanks to Crawlbase, I can now store and download tons of my data anytime I want without a huge dent in my wallet.Feb, 2022
Trusted by more than 70,000 paying customersCreate Free Account!Customer Success stories
Move your crawled and scraped data to the cloud now
Try it free. No credit card required. Instant set-up.