Crawling API / Yandex

Yandex Scraper.
Any SERP, fully rendered.

Send any Yandex search URL and get the fully rendered HTML back, through residential proxies with SmartCaptcha handling built in.
Turn it into JSON with the generic extractor.

Start freeSee it live
99% success rate140M residential IPs30 geographies
Yandex URLHTML or JSONyandex.com/search/?text=web+scrapingCrawlbaseRouteRenderExtractRendered HTMLStructured JSONcrawling-apigeneric-extractoryandex.com · rate limit rerouted · 200
Live crawl feed · Yandex1.24M req/minStreaming
200yandex.com/search/?text=crm+software&lr=143ES89ms
200yandex.com/search/?text=machine+learning+courseGB183ms
200yandex.com/search/?text=best+vpn+2026CA169ms
200yandex.ru/search/?text=%D1%80%D0%B5%D0%B9%D1%82%D0%B8%D0%BD%D0%B3+%D1%81%D0%BC%D0%B0%D1%80%D1%82%D1%84%D0%BE%D0%BD%D0%BE%D0%B2&lr=2DE84ms
200yandex.com/search/?text=residential+proxiesBR100ms
200yandex.ru/search/?text=%D0%BF%D0%B0%D1%80%D1%81%D0%B8%D0%BD%D0%B3+%D1%81%D0%B0%D0%B9%D1%82%D0%BE%D0%B2SG44ms
200yandex.com/search/?text=data+extraction+apiJP97ms
301yandex.ru/search/?text=%D0%B0%D0%B2%D0%B8%D0%B0%D0%B1%D0%B8%D0%BB%D0%B5%D1%82%D1%8B+%D0%B4%D0%B5%D1%88%D0%B5%D0%B2%D0%BEFR193ms
200yandex.ru/search/?text=%D0%BF%D0%B0%D1%80%D1%81%D0%B8%D0%BD%D0%B3+%D1%81%D0%B0%D0%B9%D1%82%D0%BE%D0%B2NL72ms
200yandex.com/search/?text=residential+proxiesAU142ms
200yandex.ru/search/?text=%D0%B0%D0%B2%D0%B8%D0%B0%D0%B1%D0%B8%D0%BB%D0%B5%D1%82%D1%8B+%D0%B4%D0%B5%D1%88%D0%B5%D0%B2%D0%BEJP171ms
200yandex.com/search/?text=python+tutorialJP147ms
200yandex.com/search/?text=machine+learning+courseES199ms
301yandex.com/search/?text=hotels+in+sochi&lr=239BR110ms
200yandex.com/search/?text=hotels+in+sochi&lr=239ES163ms
301yandex.ru/search/?text=%D0%B2%D0%B0%D0%BA%D0%B0%D0%BD%D1%81%D0%B8%D0%B8+%D0%BC%D0%B0%D1%80%D0%BA%D0%B5%D1%82%D0%BE%D0%BB%D0%BE%D0%B3&lr=54CA73ms
301yandex.ru/search/?text=%D0%BF%D0%B0%D1%80%D1%81%D0%B8%D0%BD%D0%B3+%D1%81%D0%B0%D0%B9%D1%82%D0%BE%D0%B2IN50ms
200yandex.com/search/?text=python+tutorialBR61ms
301yandex.com/search/?text=crm+software&lr=143US196ms
200yandex.com/search/?text=residential+proxiesAU209ms
200yandex.com/search/?text=seo+tools&lr=213AU95ms
200yandex.com/search/?text=residential+proxiesJP174ms
200yandex.com/search/?text=residential+proxiesBR169ms
200yandex.com/search/?text=data+extraction+apiCA181ms
200yandex.com/search/?text=seo+tools&lr=213BR146ms
200yandex.ru/search/?text=%D0%B0%D0%B2%D0%B8%D0%B0%D0%B1%D0%B8%D0%BB%D0%B5%D1%82%D1%8B+%D0%B4%D0%B5%D1%88%D0%B5%D0%B2%D0%BEES182ms
200yandex.com/search/?text=crm+software&lr=143ES89ms
200yandex.com/search/?text=machine+learning+courseGB183ms
200yandex.com/search/?text=best+vpn+2026CA169ms
200yandex.ru/search/?text=%D1%80%D0%B5%D0%B9%D1%82%D0%B8%D0%BD%D0%B3+%D1%81%D0%BC%D0%B0%D1%80%D1%82%D1%84%D0%BE%D0%BD%D0%BE%D0%B2&lr=2DE84ms
200yandex.com/search/?text=residential+proxiesBR100ms
200yandex.ru/search/?text=%D0%BF%D0%B0%D1%80%D1%81%D0%B8%D0%BD%D0%B3+%D1%81%D0%B0%D0%B9%D1%82%D0%BE%D0%B2SG44ms
200yandex.com/search/?text=data+extraction+apiJP97ms
301yandex.ru/search/?text=%D0%B0%D0%B2%D0%B8%D0%B0%D0%B1%D0%B8%D0%BB%D0%B5%D1%82%D1%8B+%D0%B4%D0%B5%D1%88%D0%B5%D0%B2%D0%BEFR193ms
200yandex.ru/search/?text=%D0%BF%D0%B0%D1%80%D1%81%D0%B8%D0%BD%D0%B3+%D1%81%D0%B0%D0%B9%D1%82%D0%BE%D0%B2NL72ms
200yandex.com/search/?text=residential+proxiesAU142ms
200yandex.ru/search/?text=%D0%B0%D0%B2%D0%B8%D0%B0%D0%B1%D0%B8%D0%BB%D0%B5%D1%82%D1%8B+%D0%B4%D0%B5%D1%88%D0%B5%D0%B2%D0%BEJP171ms
200yandex.com/search/?text=python+tutorialJP147ms
200yandex.com/search/?text=machine+learning+courseES199ms
301yandex.com/search/?text=hotels+in+sochi&lr=239BR110ms
200yandex.com/search/?text=hotels+in+sochi&lr=239ES163ms
301yandex.ru/search/?text=%D0%B2%D0%B0%D0%BA%D0%B0%D0%BD%D1%81%D0%B8%D0%B8+%D0%BC%D0%B0%D1%80%D0%BA%D0%B5%D1%82%D0%BE%D0%BB%D0%BE%D0%B3&lr=54CA73ms
301yandex.ru/search/?text=%D0%BF%D0%B0%D1%80%D1%81%D0%B8%D0%BD%D0%B3+%D1%81%D0%B0%D0%B9%D1%82%D0%BE%D0%B2IN50ms
200yandex.com/search/?text=python+tutorialBR61ms
301yandex.com/search/?text=crm+software&lr=143US196ms
200yandex.com/search/?text=residential+proxiesAU209ms
200yandex.com/search/?text=seo+tools&lr=213AU95ms
200yandex.com/search/?text=residential+proxiesJP174ms
200yandex.com/search/?text=residential+proxiesBR169ms
200yandex.com/search/?text=data+extraction+apiCA181ms
200yandex.com/search/?text=seo+tools&lr=213BR146ms
200yandex.ru/search/?text=%D0%B0%D0%B2%D0%B8%D0%B0%D0%B1%D0%B8%D0%BB%D0%B5%D1%82%D1%8B+%D0%B4%D0%B5%D1%88%D0%B5%D0%B2%D0%BEES182ms
01 Live demo

Any Yandex URL in. HTML or JSON out.

The Crawling API, typed live. Get the rendered HTML, or switch to the generic extractor for JSON. Hover to pause and read.

ready
keys 1-2 switch · click to pauserun your own URL
Run your first request in minutes. Up to 20,000 free requests, no credit card.Start free
02 Capabilities

One API, everything Yandex throws at you.

Yandex results are JavaScript-rendered, geo-gated to Russia and the CIS, and guarded by SmartCaptcha. The Crawling API renders the SERP in a real browser, reaches it through residential IPs in the right region, and hands you clean HTML or JSON.

render

Full JavaScript rendering

A real browser executes the page, so the dynamically rendered results, titles, snippets and result URLs are all captured, not just the initial HTML.

proxies

140M residential IPs

Every request rotates a residential IP across 30 geographies, with Russia and the CIS coverage, so you reach Yandex like a real local visitor.

anti-bot

SmartCaptcha handled for you

Yandex SmartCaptcha, bot walls and rate limits are cleared automatically. Nothing to solve, nothing to maintain.

format

HTML or JSON

Get the full rendered HTML, or add scraper=generic-extractor to return title, content, images and links as structured JSON.

extras

Screenshots and async

The same call can capture a full-page screenshot, or run asynchronously with webhooks and cloud storage.

one token

One API for every site

The Crawling API works on any URL, so the same token covers Yandex and everything else you crawl. See the live demo.

03 Output

Rendered HTML, or clean JSON.

By default you get the rendered HTML. Add the generic-extractor and the same page comes back as typed JSON.

{ "title": "web scraping: Yandex search", "favicon": "https://yastatic.net/favicon.ico", "meta": { "description": "Yandex search results.", "keywords": "..." }, "content": "Organic results, titles, snippets and result URLs for the query...", "canonical": "https://yandex.com/search/?text=web+scraping", "images": [ "..." ], "og_images": [ "..." ], "links": [ "..." ] }

Page

title · string  canonical · string  favicon · string

Meta

meta.description · string  meta.keywords · string

Content

content · string

Media

images · array  og_images · array

Links

links · array

04 How it works

From URL to data in one call.

Every Yandex request moves through the same path. You send a URL, we operate everything in between.

01

Send the URL

Pass any public Yandex search URL with your token: a query, a region with the lr parameter, on yandex.com or yandex.ru.

02

Rotate a proxy

A residential IP and geography that reach Yandex cleanly, with Russia and the CIS coverage, drawn from 140M IPs across 30 regions.

03

Render the page

A real browser loads the SERP so the JavaScript-rendered results, snippets and result URLs render before capture.

04

Clear anti-bot

Yandex SmartCaptcha and rate limits are handled automatically. Nothing to solve, nothing to maintain.

05

Return HTML or JSON

The fully rendered HTML comes back, or typed JSON when you add the generic extractor.

05 Use cases

What teams build on Yandex data.

USE / 01Ranking

Rank tracking

Track keyword positions on Yandex across queries and regions to monitor visibility in the RU and CIS market.

USE / 02SERP

SERP monitoring

Watch result pages for ranking shifts, new competitors and SERP features as they change.

USE / 03SEO

SEO research

Pull titles, snippets and result URLs to study intent and the competitive landscape for the RU and CIS market.

USE / 04Discovery

Link & lead discovery

Surface result URLs and domains from search pages to build link, prospect and lead lists.

USE / 05Training

Training data & RAG

Feed clean Yandex SERP text into models, RAG pipelines and agents through one API.

USE / 06Coverage

Any URL, one API

Crawl Yandex queries and regions, plus any other site you need.

06 Notes

Good to know when scraping Yandex.

Rendered like a real browser

Yandex results are JavaScript-rendered; the Crawling API runs a real browser so the organic results, titles, snippets and result URLs load before capture.

HTML by default, JSON on request

You get the full rendered HTML. Add scraper=generic-extractor for parsed title, content, images and links, or parse the result titles, snippets and URLs from the HTML yourself.

Geotargeting for Russia and the CIS

Yandex results are geo-gated, so set the country and the lr region parameter to return the local SERP from Russia and the CIS, served through residential IPs in the matching region.

SmartCaptcha cleared automatically

Yandex SmartCaptcha and volume rate limits are handled for you, so steady SERP collection keeps running without manual solving.

07 Why Crawlbase

Built to crawl Yandex at scale.

The Crawling API runs on the same network that serves 46,000+ paying customers and 70,000+ developers. No proxies to buy, no browsers to run, nothing to patch when Yandex changes.

99%
Average request success rate
140M
Residential IPs, plus 98M datacenter
30
Geographies for accurate local results
20/s
Requests per second by default, more on request

One token, official SDKs for Python, Node and Ruby, and a 99.99% uptime network underneath.

08 FAQ

Yandex scraping questions.

Send the Yandex search URL to the Crawlbase Crawling API with your token. Crawlbase rotates a residential proxy in Russia or the CIS, renders the page in a real browser, clears SmartCaptcha, and returns the fully rendered HTML. Add scraper=generic-extractor to get structured JSON instead.
Yes. By default the Crawling API returns rendered HTML; add the generic extractor (scraper=generic-extractor) to receive title, meta, content, images and links as JSON, or parse the result titles, snippets and URLs from the HTML yourself.
Yes. A real browser executes the page, so the JavaScript-rendered results, snippets and result URLs are captured, not just the initial HTML.
Crawlbase routes each request through rotating residential IPs and clears SmartCaptcha and rate limits automatically. You do not manage proxies or solve CAPTCHAs, and there is nothing to maintain when Yandex changes its setup.
Yes. Yandex results are geo-gated, so you set the country and the lr region parameter to return the local SERP you need from Russia and the CIS, with residential IPs in the matching region.
Any public URL: search result pages on yandex.com and yandex.ru, by query and region. The same API works on any other site too.
Start free with up to 20,000 requests and no credit card. Paid plans scale with usage, and the same token works across the Crawling API and every Crawlbase scraper.

Start scraping Yandex.
Skip the SmartCaptcha and blocks.

Free to begin with up to 20,000 requests. One token for the Crawling API and every scraper.

Start freeRead the docs