crawlbaseDocs
Log in

Overview

Social-media scrapers cover the public surfaces of the five platforms most teams pull from: Facebook, Instagram, TikTok, LinkedIn, and Reddit. Each scraper targets one page-type - profile, post, hashtag, event, feed, subreddit listing, comment thread - so the JSON shape stays predictable even when the underlying app refactors its UI. We handle the anti-bot, the rate limiting, and the residential routing; you receive the parsed structure.

Common use cases:

  • Brand monitoring: poll instagram-profile / tiktok-profile for follower count, posting cadence, and engagement trends across competitors and influencers.
  • Influencer discovery: walk instagram-hashtag or instagram-reels-audio to find creators using a given hashtag or trending sound.
  • Recruiting / sales prospecting: enrich a CRM with linkedin-profile and linkedin-company data - title, headcount, headline, current role.
  • Event marketing: pull facebook-event attendance and timing for tracking event saturation in a city or industry vertical.
  • Trend research: feed tiktok-product and instagram-post into trend-detection pipelines for marketing or product research.
  • Community & sentiment research: pull reddit-subreddit and reddit-post for ranked posts and full comment trees to track sentiment, product feedback, and emerging discussion.

Only public surfaces are supported - login-walled or private content is out of scope and not something the scrapers attempt. Where a platform has multiple post types (Instagram has profile + post + reel + hashtag, for example), each gets its own scraper so you don't pay for fields you don't need.

Facebook

Public Facebook surfaces - pages, profiles, groups, hashtags, events. Useful for brand monitoring, event marketing, and discovery in regions where Facebook has higher share than Instagram (most of EMEA, parts of LATAM).

Instagram

Five Instagram scrapers covering the surfaces most relevant to influencer marketing and trend research - profiles, individual posts and reels, hashtag feeds, and reels-audio for music/sound-driven trend tracking.

TikTok

TikTok profiles and individual video/product posts. Pair with tiktok-shop in the E-Commerce category if you're tracking creator commerce.

LinkedIn

Public LinkedIn - profiles, company pages, and feed posts. The standard fit for B2B prospecting, recruiting, and competitive headcount tracking.

Reddit

Public Reddit surfaces - subreddit listings, search results, and single posts with their full comment trees. The fit for community monitoring, sentiment analysis, and trend detection across topic-specific communities.

  • Reddit Subreddit - ranked posts from a subreddit listing (title, author, score, comment count, flair, pagination).
  • Reddit Search - Reddit search results - matching posts plus related subreddits.
  • Reddit Post - single post with body, score, upvote ratio, and the full nested comment tree.

Example call

Below: a single instagram-profile call. The scraper returns the public profile snapshot - username, bio, follower/following counts, post count, verification flag, and avatar URL.

curl 'https://api.crawlbase.com/?token=YOUR_TOKEN' \
  --data-urlencode 'url=https://www.instagram.com/apple/' \
  --data-urlencode 'scraper=instagram-profile' -G

Sample response

{
  "username": "apple",
  "full_name": "Apple",
  "biography": "Welcome to @apple. The latest creativity going on around us.",
  "followers_count": 33800000,
  "following_count": 9,
  "posts_count": 1284,
  "is_verified": true,
  "is_private": false,
  "profile_pic_url": "https://scontent.cdninstagram.com/...jpg"
}

Full reference (parameters, all 4 SDK languages, edge cases): Instagram Profile - full reference