# Data Scrapers

When using the Crawling API you will get back the complete page HTML but if you want to get back the scraped content instead, you can use any of the available scrapers that we have. For unavailable scrapers you will have to get back the full HTML and scrape the content yourself.

Our available scrapers allow you to extract the data directly from a website without the need to build HTML parsers while using our Crawling API.

Scrapers are optional, and you can always get back the full HTML of the page if you use the API without any scraper.

To start, choose a scraper from the sidebar to extract the data. Please contact support if you have questions or need help.

# Amazon

To use Amazon scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Get price, title, availability, description, images, reviews and offer listings and much more information for any Amazon product.
Get structured SERP and formatted best sellers search results from Amazon.

# amazon-product-details

Scraper for generic Amazon product page details

API usage:

&scraper=amazon-product-details

Example input url (make sure the url is encoded):

https://www.amazon.com/Apple-iPhone-Silicone-Case-MagSafe/dp/B0CHX2XFLN

Example output:

# amazon-serp

Scraper for Amazon search results page, returns array of products

API usage:

&scraper=amazon-serp

Example input url (make sure the url is encoded):

https://www.amazon.com/s?k=games

Example output:

# amazon-offer-listing

Scraper for generic Amazon offer listing page details.

API usage:

&scraper=amazon-offer-listing

Example input url (make sure the url is encoded):

https://www.amazon.com/gp/offer-listing/B07S5QWM6L

Example output:

# amazon-product-reviews

Scraper for generic Amazon product reviews page details.

API usage:

&scraper=amazon-product-reviews

Example input url (make sure the url is encoded):

https://www.amazon.com/hz/reviews-render/ajax/medley-filtered-reviews/get/ref=cm_cr_dp_d_fltrs_srt?scope=reviewsAjax0&asin=B08PN7R2MZ&pageNumber=10

Example output:

# amazon-best-sellers

Scraper for Amazon Best Sellers results page, returns array of products.

API usage:

&scraper=amazon-best-sellers

Example input url (make sure the url is encoded):

https://www.amazon.com/Best-Sellers-Electronics/zgbs/electronics

Example output:

# amazon-new-releases

Scraper for Amazon New Releases page, returns array of products.

API usage:

&scraper=amazon-new-releases

Example input url (make sure the url is encoded):

https://www.amazon.com/new-releases/handmade

Example output:

# Google

To use Google scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Get structured search results from Google including main sections (ads, related search results, people also ask, snack pack).

# google-serp

Scraper for Google search results page, returns array of results

API usage:

&scraper=google-serp

Example input url (make sure the url is encoded):

https://www.google.com/search?q=samsung+shops

Example output:

# Facebook

Tip

The following Facebook scrapers may work better with your JavaScript (JS) token. If you are getting an empty response with your TCP token, please switch to using the JS token.

To use Facebook scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Extract public group name, description, images, feeds and their corresponding comments with other details from Facebook group pages.
Get structured and formatted Facebook page details.
Extract profile name, profile & cover images, work & education, friends count and other profiles with similar names.

# facebook-group

Scraper for generic Facebook group page details

API usage:

&scraper=facebook-group

Example input url (make sure the url is encoded):

https://www.facebook.com/groups/198722650913932

Example output:

# facebook-page

Scraper for generic Facebook page details

API usage:

&scraper=facebook-page

Example input url (make sure the url is encoded):

https://www.facebook.com/Amazon/

Example output:

# facebook-profile

Scraper for generic Facebook profile

API usage:

&scraper=facebook-profile

Example input url (make sure the url is encoded):

https://www.facebook.com/zuck

Example output:

# facebook-hashtag

Scraper for Facebook hashtag

API usage:

&scraper=facebook-hashtag

Example input url (make sure the url is encoded):

https://www.facebook.com/hashtag/robots

Example output:

# facebook-event

Scraper for Facebook event

API usage:

&scraper=facebook-event

Example input url (make sure the url is encoded):

https://www.facebook.com/events/1543404119289643

Example output:

# Instagram

Tip

The following Instagram scrapers may work better with your JavaScript (JS) token. If you are getting an empty response with your TCP token, please switch to using the JS token.

To use Instagram scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Get post and profile details including media, hashtags, captions, location and their corresponding replies from Instagram posts.
Extract posts details from hashtag pages.

# instagram-post

Scraper for generic Instagram post details

API usage:

&scraper=instagram-post

Example input url (make sure the url is encoded):

https://www.instagram.com/p/B5LQhLiFFCX

Example output:

# instagram-profile

Scraper for generic Instagram profile details

API usage:

&scraper=instagram-profile

Example input url (make sure the url is encoded):

https://www.instagram.com/apple/

Example output:

# instagram-hashtag

Note:

The instagram-hashtag scraper is currently not available due to changes from Instagram. We are working on a fix, but we do not have an ETA at this time.

Scraper for generic Instagram hashtag pages

API usage:

&scraper=instagram-hashtag

Example input url (make sure the url is encoded):

https://www.instagram.com/explore/tags/love/

Example output:

# instagram-reels-audio

Scraped data for Instagram reels by specific audio URL

API usage:

&scraper=instagram-reels-audio

Example input url (make sure the url is encoded):

https://www.instagram.com/reels/audio/430642407673774

Example output:

# LinkedIn

To use LinkedIn scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Extract Profile experience, education, activities, publications, volunteering, and all other profile sections from LinkedIn.
Get Company description, employees' main details, locations and many more details from LinkedIn.

# linkedin-profile

Scraper for generic LinkedIn profile details

API usage:

&scraper=linkedin-profile

Example input url (make sure the url is encoded):

https://www.linkedin.com/in/kaitlyn-owen

Example output:

# linkedin-company

Scraper for generic LinkedIn company details

API usage:

&scraper=linkedin-company

Example input url (make sure the url is encoded):

https://www.linkedin.com/company/amazon

Example output:

# linkedin-feed

Scraper for generic LinkedIn feed that transforms the feeds into JSON data, enabling efficient analysis and data-driven decisions.

API usage:

&scraper=linkedin-feed

Example input url (make sure the url is encoded):

https://www.linkedin.com/feed/update/urn:li:activity:7022155503770251267

Example output:

# Quora

To use Quora scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Get formatted question search results from Quora.
Extract question details including ads, wiki, tags, answers and related questions from Quora.

# quora-serp

Note:

The quora-serp scraper is currently not available due to changes from Quora. We are working on a fix, but we do not have an ETA at this time.

Tip

To retrieve additional data using this scraper, kindly append the parameter &css_click_selector=.q-text.qu-cursor--pointer. This will ensure you maximize your data extraction.

Scraper for Quora search results page, returns array of questions

API usage:

&scraper=quora-serp

Example input url (make sure the url is encoded):

https://www.quora.com/search?q=websitevoice

Example output:

# quora-question

Scraper for generic Quora question details along with all answers

API usage:

&scraper=quora-question

Example input url (make sure the url is encoded):

https://www.quora.com/Which-is-the-best-tool-for-scraping-customer-reviews

Example output:

# Airbnb

To use Airbnb scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Get formatted search results from Airbnb.
Get Airbnb residents list with title, location, accomodation, amenities, rating costs etc

# airbnb-serp

Scraper for Airbnb search results page, returns array of residents

API usage:

&scraper=airbnb-serp

Example input url (make sure the url is encoded):

https://www.airbnb.com/s/Beirut/homes

Example output:

# Ebay

To use Ebay scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Get price, title, availability, description, images, shipping summaries and much more information for any Ebay product.
Get structured SERP from Ebay.

# ebay-serp

Scraper for Ebay search results page, returns array of products

API usage:

&scraper=ebay-serp

Example input url (make sure the url is encoded):

https://www.ebay.com/sch/i.html?_nkw=iphone+x

Example output:

# ebay-product

Scraper for Ebay product page details

API usage:

&scraper=ebay-product

Example input url (make sure the url is encoded):

https://www.ebay.com/itm/156078647276

Example output:

# AliExpress

Tip

The following AliExpress scrapers may work better with your JavaScript (JS) token. If you are getting an empty response with your TCP token, please switch to using the JS token.

To use AliExpress scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Get price, title, availability, description, images, reviews, shipping summaries and many other details for any AliExpress product.
Get structured SERP from AliExpress.

# aliexpress-product

Scraper for AliExpress product page details

API usage:

&scraper=aliexpress-product

Example input url (make sure the url is encoded):

https://www.aliexpress.com/item/4000275547643.html

Example output:

# aliexpress-serp

Scraper for AliExpress search results page, returns array of products

API usage:

&scraper=aliexpress-serp

Example input url (make sure the url is encoded):

https://www.aliexpress.com/wholesale?SearchText=water+bottle

Example output:

# Bing

To use Bing scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Get structured search results from Bing including video links and related search result links.

# bing-serp

Scraper for Bing search results page, returns array of results

API usage:

&scraper=bing-serp

Example input url (make sure the url is encoded):

https://www.bing.com/search?q=samsung+shops

Example output:

# Immobilienscout24

To use Immobilienscout24 scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Get structured property details from Immobilienscout24.

# immobilienscout24-property

Scraper for immobilienscout24 property page details.

API usage:

&scraper=immobilienscout24-property

Example input url (make sure the url is encoded):

https://www.immobilienscout24.de/expose/144832356

Example output:

# Walmart

To use Walmart scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Get price, title, description, images, reviews and ratings and much more information for any Walmart product.
Get formatted search results from Walmart search results page.
Get formatted data from Walmart category page.

# walmart-serp

Scraper for Walmart search results page.

API usage:

&scraper=walmart-serp

Example input url (make sure the url is encoded):

https://www.walmart.com/search?q=samsung+galaxy

Example output:

# walmart-product-details

Scraper for Walmart product page details

API usage:

&scraper=walmart-product-details

Example input url (make sure the url is encoded):

https://www.walmart.com/ip/Meta-Quest-3-512GB-Breakthrough-Mixed-Reality-Powerful-Performance-Asgard-s-Wrath-2/3551794083

Example output:

# walmart-category

Scraper for Walmart category page.

API usage:

&scraper=walmart-category

Example input url (make sure the url is encoded):

https://www.walmart.com/browse/home/dorm-decor/4044_1225301_1225229_7471338

Example output:

# BestBuy

To use BestBuy scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Get formatted search results from BestBuy search results page.
Get price, title, description, images, reviews and ratings and much more information for any BestBuy product.

# bestbuy-serp

Scraper for BestBuy search results page.

API usage:

&scraper=bestbuy-serp

Example input url (make sure the url is encoded):

https://www.bestbuy.com/site/searchpage.jsp?st=gaming+chair

Example output:

# bestbuy-product-details

Scraper for BestBuy product page details

API usage:

&scraper=bestbuy-product-details

Example input url (make sure the url is encoded):

https://www.bestbuy.com/site/meta-quest-3-512gb-the-most-powerful-quest-ultimate-mixed-reality-experiences-get-batman-arkham-shadow-white/6596938.p

Example output:

# G2

To use G2 scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Get name, description, ratings, images, reviews and video reviews and much more information for any G2 product.

# g2-product-reviews

Scraper for G2 product reviews page.

API usage:

&scraper=g2-product-reviews

Example input url (make sure the url is encoded):

https://www.g2.com/products/zoom/reviews

Example output:

# Eventbrite

To use Eventbrite scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Extract a list of events or detailed event information including event title, images, price, discount, description, date/time, organizer, slots, and more.

# eventbrite-events-list

Scraper for Eventbrite search events result.

API usage:

&scraper=eventbrite-events-list

Example input url (make sure the url is encoded):

https://www.eventbrite.com/d/ny--new-york/ai/

Example output:

# eventbrite-event-details

Scraper for Eventbrite event details page.

API usage:

&scraper=eventbrite-event-details

Example input url (make sure the url is encoded):

https://www.eventbrite.com/e/marketing-essentials-1-day-training-in-new-york-city-ny-tickets-814175078577

Example output:

# Generic

To use Generic scrapers, use the API like you would regularly and add the &scraper= parameter to get back the HTML parsed in JSON format.

Generic extractions of links, images, emails and other content from any website page.

# generic-extractor

A generic scraper to extract content from any website page.

API usage:

&scraper=generic-extractor

Example input url (make sure the url is encoded):

https://stackoverflow.com/

Example output:

# email-extractor

A generic email scraper to extract emails from any website page.

API usage:

&scraper=email-extractor

Example input url (make sure the url is encoded):

https://letsencrypt.org/contact/

Example output:

← PUT Requests Proxy Mode →