# Parameters

The Scraper API has the following parameters, only the token and url are mandatory, the rest are optional.

# token

• Required
• Type string

This parameter is required for all calls

This is your authentication token. All your requests must be authorized with your private token.

curl "https://api.crawlbase.com/scraper?token=_USER_TOKEN_&url=https%3A%2F%2Fwww.amazon.com%2Fdp%2FB00JITDVD2"

require 'net/http'

uri = URI('https://api.crawlbase.com/scraper')
uri.query = URI.encode_www_form({
  token: '_USER_TOKEN_',
  url: 'https://www.amazon.com/dp/B00JITDVD2'})

res = Net::HTTP.get_response(uri)
puts "Response HTTP Status Code: \#{res.code}"
puts "Response HTTP Header Original Status: \#{res['original_status']}"
puts "Response HTTP Response Body: \#{res.body}"

const https = require('https');

const url = encodeURIComponent('https://www.amazon.com/dp/B00JITDVD2');
const options = {
  hostname: 'api.crawlbase.com',
  path: '/scraper?token=_USER_TOKEN_&url=' + url
};

https.request(options, (response) => {
  let body = '';
  response.on('data', chunk => body += chunk).on('end', () => console.log(body));
}).end();

$url = urlencode('https://www.amazon.com/dp/B00JITDVD2');

$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, 'https://api.crawlbase.com/scraper?token=_USER_TOKEN_&url=' . $url);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);

$response = curl_exec($ch);
curl_close($ch);

var_dump($response);

from urllib2 import urlopen
from urllib import quote_plus

url = quote_plus('https://www.amazon.com/dp/B00JITDVD2')

handler = urlopen('https://api.crawlbase.com/scraper?token=_USER_TOKEN_&url=' + url)

package main

import (
  "net/http"
  "fmt"
  "io/ioutil"
  "net/url"
)

func main() {
  url := url.QueryEscape("https://www.amazon.com/dp/B00JITDVD2")
  resp, _ := http.Get("https://api.crawlbase.com/scraper?token=_USER_TOKEN_&url=" + url)

  defer resp.Body.Close()
  body, _ := ioutil.ReadAll(resp.Body)

  fmt.Println("response Body: ", string(body))

# url

• Required
• Type string

This parameter is required for all calls

You will need a url to crawl. Make sure it starts with http or https and that is fully encoded.

For example, in the following url: https://www.amazon.com/Jabra-Move-Wireless-Stereo-Headphones/dp/B00MR8Z28S/ the url should be encoded when calling the API like the following: https%3A%2F%2Fwww.amazon.com%2FJabra-Move-Wireless-Stereo-Headphones%2Fdp%2FB00MR8Z28S%2F

curl "https://api.crawlbase.com/scraper?token=_USER_TOKEN_&url=https%3A%2F%2Fwww.instagram.com%2Fp%2FB5LQhLiFFCX"

require 'net/http'

uri = URI('https://api.crawlbase.com/scraper')
uri.query = URI.encode_www_form({
  token: '_USER_TOKEN_',
  url: 'https://www.instagram.com/p/B5LQhLiFFCX'})

res = Net::HTTP.get_response(uri)
puts "Response HTTP Status Code: \#{res.code}"
puts "Response HTTP Header Original Status: \#{res['original_status']}"
puts "Response HTTP Response Body: \#{res.body}"

const https = require('https');

const url = encodeURIComponent('https://www.instagram.com/p/B5LQhLiFFCX');
const options = {
  hostname: 'api.crawlbase.com',
  path: '/scraper?token=_USER_TOKEN_&url=' + url
};

https.request(options, (response) => {
  let body = '';
  response.on('data', chunk => body += chunk).on('end', () => console.log(body));
}).end();

$url = urlencode('https://www.instagram.com/p/B5LQhLiFFCX');

$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, 'https://api.crawlbase.com/scraper?token=_USER_TOKEN_&url=' . $url);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);

$response = curl_exec($ch);
curl_close($ch);

var_dump($response);

from urllib2 import urlopen
from urllib import quote_plus

url = quote_plus('https://www.instagram.com/p/B5LQhLiFFCX')

handler = urlopen('https://api.crawlbase.com/scraper?token=_USER_TOKEN_&url=' + url)

print handler.read()

package main

import (
  "net/http"
  "fmt"
  "io/ioutil"
  "net/url"
)

func main() {
  url := url.QueryEscape("https://www.instagram.com/p/B5LQhLiFFCX")
  resp, _ := http.Get("https://api.crawlbase.com/scraper?token=_USER_TOKEN_&url=" + url)

  defer resp.Body.Close()
  body, _ := ioutil.ReadAll(resp.Body)

  fmt.Println("response Body: ", string(body))

# country

• Optional
• Type string

If you want your requests to be geolocated from a specific country, you can use the &country= parameter, like &country=US (two-character country code).

Please check the list of supported countries in the Crawling API country parameter.

Geolocated scraping requests are available depending on your subscription. If your current subscription does not allow geolocated requests, then please upgrade your subscription.

# javascript

• Optional
• Type boolean

If you want your requests to render JavaScript in real chrome browsers, you can use the &javascript=true parameter. Please note that using the javascript parameter consumes 2 credits from your subscription total credits.

Browser enabled scraping requests are available depending on your subscription. If your current subscription does not allow JavaScript requests, then please upgrade your subscription.

# premium

• Optional
• Type boolean

If you want your requests to pass through the premium residential networks, you can use the &premium=true parameter. Please note that using the premium parameter consumes 10 credits from your subscription total credits. If you combine &premium=true with &javascript=true that consumes 20 credits from your subscription total credits.

Premium scraping requests are available depending on your subscription. If your current subscription does not allow premium requests, then please upgrade your subscription.