Crawling API / YandexYandex Scraper.
Yandex Scraper.
Any SERP, fully rendered.
Send any Yandex search URL and get the fully rendered HTML back, through residential proxies with SmartCaptcha handling built in.
Turn it into JSON with the generic extractor.
Live crawl feed · Yandex1.24M req/minStreaming
200yandex.com/search/?text=hotels+in+sochi&lr=239ES164ms
200yandex.com/search/?text=seo+tools&lr=213NL51ms
200yandex.com/search/?text=seo+tools&lr=213FR169ms
200yandex.ru/search/?text=%D0%BD%D0%B5%D0%B4%D0%B2%D0%B8%D0%B6%D0%B8%D0%BC%D0%BE%D1%81%D1%82%D1%8C+%D0%BC%D0%BE%D1%81%D0%BA%D0%B2%D0%B0&lr=213GB176ms
200yandex.ru/search/?text=%D1%80%D0%B5%D0%B9%D1%82%D0%B8%D0%BD%D0%B3+%D1%81%D0%BC%D0%B0%D1%80%D1%82%D1%84%D0%BE%D0%BD%D0%BE%D0%B2&lr=2DE77ms
301yandex.com/search/?text=web+scrapingGB113ms
301yandex.com/search/?text=web+scrapingNL81ms
200yandex.com/search/?text=crm+software&lr=143GB112ms
200yandex.com/search/?text=crm+software&lr=143SG152ms
200yandex.com/search/?text=data+extraction+apiDE43ms
200yandex.com/search/?text=crm+software&lr=143NL133ms
200yandex.ru/search/?text=%D0%BF%D0%B0%D1%80%D1%81%D0%B8%D0%BD%D0%B3+%D1%81%D0%B0%D0%B9%D1%82%D0%BE%D0%B2IN207ms
200yandex.ru/search/?text=%D0%B2%D0%B0%D0%BA%D0%B0%D0%BD%D1%81%D0%B8%D0%B8+%D0%BC%D0%B0%D1%80%D0%BA%D0%B5%D1%82%D0%BE%D0%BB%D0%BE%D0%B3&lr=54ES40ms
200yandex.com/search/?text=python+tutorialNL54ms
301yandex.com/search/?text=data+extraction+apiJP103ms
200yandex.com/search/?text=machine+learning+courseAU81ms
404yandex.ru/search/?text=%D0%BD%D0%B5%D0%B4%D0%B2%D0%B8%D0%B6%D0%B8%D0%BC%D0%BE%D1%81%D1%82%D1%8C+%D0%BC%D0%BE%D1%81%D0%BA%D0%B2%D0%B0&lr=213BR213ms
200yandex.com/search/?text=machine+learning+courseCA138ms
200yandex.com/search/?text=electric+carsCA219ms
200yandex.com/search/?text=residential+proxiesDE55ms
200yandex.com/search/?text=best+vpn+2026CA101ms
200yandex.ru/search/?text=%D0%BF%D0%B0%D1%80%D1%81%D0%B8%D0%BD%D0%B3+%D1%81%D0%B0%D0%B9%D1%82%D0%BE%D0%B2JP164ms
200yandex.ru/search/?text=%D0%B0%D0%B2%D0%B8%D0%B0%D0%B1%D0%B8%D0%BB%D0%B5%D1%82%D1%8B+%D0%B4%D0%B5%D1%88%D0%B5%D0%B2%D0%BEFR133ms
404yandex.com/search/?text=seo+tools&lr=213ES117ms
200yandex.com/search/?text=web+scrapingSG64ms
200yandex.com/search/?text=web+scrapingSG138ms
200yandex.com/search/?text=hotels+in+sochi&lr=239ES164ms
200yandex.com/search/?text=seo+tools&lr=213NL51ms
200yandex.com/search/?text=seo+tools&lr=213FR169ms
200yandex.ru/search/?text=%D0%BD%D0%B5%D0%B4%D0%B2%D0%B8%D0%B6%D0%B8%D0%BC%D0%BE%D1%81%D1%82%D1%8C+%D0%BC%D0%BE%D1%81%D0%BA%D0%B2%D0%B0&lr=213GB176ms
200yandex.ru/search/?text=%D1%80%D0%B5%D0%B9%D1%82%D0%B8%D0%BD%D0%B3+%D1%81%D0%BC%D0%B0%D1%80%D1%82%D1%84%D0%BE%D0%BD%D0%BE%D0%B2&lr=2DE77ms
301yandex.com/search/?text=web+scrapingGB113ms
301yandex.com/search/?text=web+scrapingNL81ms
200yandex.com/search/?text=crm+software&lr=143GB112ms
200yandex.com/search/?text=crm+software&lr=143SG152ms
200yandex.com/search/?text=data+extraction+apiDE43ms
200yandex.com/search/?text=crm+software&lr=143NL133ms
200yandex.ru/search/?text=%D0%BF%D0%B0%D1%80%D1%81%D0%B8%D0%BD%D0%B3+%D1%81%D0%B0%D0%B9%D1%82%D0%BE%D0%B2IN207ms
200yandex.ru/search/?text=%D0%B2%D0%B0%D0%BA%D0%B0%D0%BD%D1%81%D0%B8%D0%B8+%D0%BC%D0%B0%D1%80%D0%BA%D0%B5%D1%82%D0%BE%D0%BB%D0%BE%D0%B3&lr=54ES40ms
200yandex.com/search/?text=python+tutorialNL54ms
301yandex.com/search/?text=data+extraction+apiJP103ms
200yandex.com/search/?text=machine+learning+courseAU81ms
404yandex.ru/search/?text=%D0%BD%D0%B5%D0%B4%D0%B2%D0%B8%D0%B6%D0%B8%D0%BC%D0%BE%D1%81%D1%82%D1%8C+%D0%BC%D0%BE%D1%81%D0%BA%D0%B2%D0%B0&lr=213BR213ms
200yandex.com/search/?text=machine+learning+courseCA138ms
200yandex.com/search/?text=electric+carsCA219ms
200yandex.com/search/?text=residential+proxiesDE55ms
200yandex.com/search/?text=best+vpn+2026CA101ms
200yandex.ru/search/?text=%D0%BF%D0%B0%D1%80%D1%81%D0%B8%D0%BD%D0%B3+%D1%81%D0%B0%D0%B9%D1%82%D0%BE%D0%B2JP164ms
200yandex.ru/search/?text=%D0%B0%D0%B2%D0%B8%D0%B0%D0%B1%D0%B8%D0%BB%D0%B5%D1%82%D1%8B+%D0%B4%D0%B5%D1%88%D0%B5%D0%B2%D0%BEFR133ms
404yandex.com/search/?text=seo+tools&lr=213ES117ms
200yandex.com/search/?text=web+scrapingSG64ms
200yandex.com/search/?text=web+scrapingSG138ms
01 Live demo
Any Yandex URL in. HTML or JSON out.
The Crawling API, typed live. Get the rendered HTML, or switch to the generic extractor for JSON. Hover to pause and read.
Run your first request in minutes. Up to 10,000 free requests, no credit card.Start free
02 Capabilities
One API, everything Yandex throws at you.
Yandex results are JavaScript-rendered, geo-gated to Russia and the CIS, and guarded by SmartCaptcha. The Crawling API renders the SERP in a real browser, reaches it through residential IPs in the right region, and hands you clean HTML or JSON.
render
Full JavaScript rendering
A real browser executes the page, so the dynamically rendered results, titles, snippets and result URLs are all captured, not just the initial HTML.
proxies
140M residential IPs
Every request rotates a residential IP across 30 geographies, with Russia and the CIS coverage, so you reach Yandex like a real local visitor.
anti-bot
SmartCaptcha handled for you
Yandex SmartCaptcha, bot walls and rate limits are cleared automatically. Nothing to solve, nothing to maintain.
format
HTML or JSON
Get the full rendered HTML, or add scraper=generic-extractor to return title, content, images and links as structured JSON.
extras
Screenshots and async
The same call can capture a full-page screenshot, or run asynchronously with webhooks and cloud storage.
one token
One API for every site
The Crawling API works on any URL, so the same token covers Yandex and everything else you crawl. See the live demo.
03 Output
Rendered HTML, or clean JSON.
By default you get the rendered HTML. Add the generic-extractor and the same page comes back as typed JSON.
{
"title": "web scraping: Yandex search",
"favicon": "https://yastatic.net/favicon.ico",
"meta": { "description": "Yandex search results.", "keywords": "..." },
"content": "Organic results, titles, snippets and result URLs for the query...",
"canonical": "https://yandex.com/search/?text=web+scraping",
"images": [ "..." ],
"og_images": [ "..." ],
"links": [ "..." ]
}
Page
title · string canonical · string favicon · string
Meta
meta.description · string meta.keywords · string
Content
content · string
Media
images · array og_images · array
Links
links · array
04 How it works
From URL to data in one call.
Every Yandex request moves through the same path. You send a URL, we operate everything in between.
01
Send the URL
Pass any public Yandex search URL with your token: a query, a region with the lr parameter, on yandex.com or yandex.ru.
02
Rotate a proxy
A residential IP and geography that reach Yandex cleanly, with Russia and the CIS coverage, drawn from 140M IPs across 30 regions.
03
Render the page
A real browser loads the SERP so the JavaScript-rendered results, snippets and result URLs render before capture.
04
Clear anti-bot
Yandex SmartCaptcha and rate limits are handled automatically. Nothing to solve, nothing to maintain.
05
Return HTML or JSON
The fully rendered HTML comes back, or typed JSON when you add the generic extractor.
05 Use cases
What teams build on Yandex data.
USE / 01Ranking
Rank tracking
Track keyword positions on Yandex across queries and regions to monitor visibility in the RU and CIS market.
USE / 02SERP
SERP monitoring
Watch result pages for ranking shifts, new competitors and SERP features as they change.
USE / 03SEO
SEO research
Pull titles, snippets and result URLs to study intent and the competitive landscape for the RU and CIS market.
USE / 04Discovery
Link & lead discovery
Surface result URLs and domains from search pages to build link, prospect and lead lists.
USE / 05Training
Training data & RAG
Feed clean Yandex SERP text into models, RAG pipelines and agents through one API.
USE / 06Coverage
Any URL, one API
Crawl Yandex queries and regions, plus any other site you need.
06 Notes
Good to know when scraping Yandex.
Rendered like a real browser
Yandex results are JavaScript-rendered; the Crawling API runs a real browser so the organic results, titles, snippets and result URLs load before capture.
HTML by default, JSON on request
You get the full rendered HTML. Add scraper=generic-extractor for parsed title, content, images and links, or parse the result titles, snippets and URLs from the HTML yourself.
Geotargeting for Russia and the CIS
Yandex results are geo-gated, so set the country and the lr region parameter to return the local SERP from Russia and the CIS, served through residential IPs in the matching region.
SmartCaptcha cleared automatically
Yandex SmartCaptcha and volume rate limits are handled for you, so steady SERP collection keeps running without manual solving.
07 Why Crawlbase
Built to crawl Yandex at scale.
The Crawling API runs on the same network that serves 46,000+ paying customers and 70,000+ developers. No proxies to buy, no browsers to run, nothing to patch when Yandex changes.
99%
Average request success rate
140M
Residential IPs, plus 98M datacenter
30
Geographies for accurate local results
20/s
Requests per second by default, more on request
One token, official SDKs for Python, Node and Ruby, and a 99.99% uptime network underneath.
08 FAQ
Yandex scraping questions.
Send the Yandex search URL to the Crawlbase Crawling API with your token. Crawlbase rotates a residential proxy in Russia or the CIS, renders the page in a real browser, clears SmartCaptcha, and returns the fully rendered HTML. Add scraper=generic-extractor to get structured JSON instead.
Yes. By default the Crawling API returns rendered HTML; add the generic extractor (scraper=generic-extractor) to receive title, meta, content, images and links as JSON, or parse the result titles, snippets and URLs from the HTML yourself.
Yes. A real browser executes the page, so the JavaScript-rendered results, snippets and result URLs are captured, not just the initial HTML.
Crawlbase routes each request through rotating residential IPs and clears SmartCaptcha and rate limits automatically. You do not manage proxies or solve CAPTCHAs, and there is nothing to maintain when Yandex changes its setup.
Yes. Yandex results are geo-gated, so you set the country and the lr region parameter to return the local SERP you need from Russia and the CIS, with residential IPs in the matching region.
Any public URL: search result pages on yandex.com and yandex.ru, by query and region. The same API works on any other site too.
Start free with up to 10,000 requests and no credit card. Paid plans scale with usage, and the same token works across the Crawling API and every Crawlbase scraper.
Start scraping Yandex.
Skip the SmartCaptcha and blocks.
Free to begin with up to 10,000 requests. One token for the Crawling API and every scraper.