Cookbook·News and media·miamiherald.com

Scrape articles on miamiherald.com

The call that returns articles from miamiherald.com today, with the parameters, patterns and failure modes read off the request log since 14 Aug 2026. Last tested 6 Sep 2026.

93.3% success · Aug 2026Browser on 7% of callsStandard price · 1 credit

About miamiherald.com

miamiherald.com describes itself as “Stay updated with the latest Miami news covering crime, business, sports, entertainment, and more across Miami-Dade, the Keys, and Broward”.

Its sitemaps list 9,068 URLs across 19 files (update). 68 of the 9,068 dated entries changed in the last 30 days, the newest on 6 Sep 2026.

Its robots.txt names 13 sitemaps and disallows 12 paths, among them /search, /web, /mrcontent. It asks crawlers to wait 3s between requests.

Measured on Crawlbase

Success rate over every request from every account in August 2026: 93.3%. Patterns, countries and failures come from the request log since 14 Aug 2026; 6.8% of successful calls used the JavaScript token and the median answer took 1.3s.

Among the 74 news and media sites in the Cookbook, miamiherald.com ranks 66 of 74 by success rate; the category median is 98.9%. Its median answer of 1.3s is faster than the category median of 2.3s. 58 of the 74 accept the plain token; this one does on some pages only.

The call

Article pages are the shape the accounts fetch most here, with the country and token that succeed most often. Replace the placeholder path with a real article URL from the site.

Run in Playground

curl "https://api.crawlbase.com/?token=YOUR_TOKEN&url=https%3A%2F%2Fwww.miamiherald.com%2Fnews%2Fstate%2Farticle2629551.html"

from crawlbase import CrawlingAPI
api = CrawlingAPI({'token': 'YOUR_TOKEN'})

r = api.get('https://www.miamiherald.com/news/state/article2629551.html')
html = r['body']

const { CrawlingAPI } = require('crawlbase');
const api = new CrawlingAPI({ token: 'YOUR_TOKEN' });

const r = await api.get('https://www.miamiherald.com/news/state/article2629551.html');

Parameters that matter

Parameter	Set it to	Why
`country`	leave unset	Most successful calls set no country (99.4%) and succeed at 93.5%.
`javascript`	leave unset	Plain-token calls succeed at 93.5% and make up 92.8% of the traffic. A browser costs more and, on this site, buys nothing.

URL patterns accounts fetch

Pattern	Share of successes	JavaScript token	Country	Query parameters
`/news/{slug}/{slug}`	48.0%	0.0%	none	none
`/sports/{slug}/{slug}`	28.8%	0.0%	none	none
`/living/{slug}`	9.3%	0.0%	none	none
`/opinion/{slug}/{slug}`	3.5%	0.0%	none	none
`/{slug}/{slug}/{slug}`	3.0%	8.3%	none	none

Fields you get

Structured data Crawlbase found on miamiherald.com, by page type. These are the schema.org types in the page, the fields your parser can read straight from the JSON-LD block:

Home: NewsMediaOrganization
Article: NewsArticle
Other: NewsArticle

What breaks, and the fix

Of the failures since 14 Aug 2026, the site answered:

403: 44.8% of failures A 403 is the site refusing the exit. Set the country the successful calls use and retry once; a second 403 means the URL itself is protected.

0: 25.4% of failures A status of 0 is a request that never got an answer inside the timeout. Retry once with the JavaScript token if the pattern needs a browser.

408: 20.9% of failures 408 means the site refused the fetch. Treat it like a block: retry once with the JavaScript token and the country the successful calls use, then stop.

Run it on a schedule

News moves by the hour. Poll the section or the sitemap for new links, then push the article URLs to the Crawler with a callback so the fetches are paced. The median answer on this site is 1.3s.

Questions

Do I need a browser to scrape miamiherald.com?

No. 93.5% of plain-token calls succeed and accounts send 92.8% of their traffic without a browser.

How much does a miamiherald.com page cost on Crawlbase?

1 credit without a browser. miamiherald.com is in the standard tier.

Which country should I set for miamiherald.com?

None is needed: most successful calls leave it unset.

Other pages on miamiherald.com

Pages miamiherald.com lists in its own sitemaps, fetched by Crawlbase on 6 Sep 2026 and verified in 2 consecutive runs. Each row is the cheapest call that returned the page with its content.

Page	Example	Token	Country	Median
Home `/` Structured data: NewsMediaOrganization	miamiherald.com/	Plain	none	2.1s
Article `/news/{slug}/{slug}` Structured data: NewsArticle	miamiherald.com/news/state/article2629551.html	JavaScript	none	11.9s
Other `/{slug}/{slug}/{slug}` Structured data: NewsArticle	none	Plain	none	3.9s

Measured on CrawlbaseAUGUST 2026

Success rate93.3%

Needs browser7% of calls

Price tierStandard · 1 credit

Last retest6 Sep 2026

How we count: every request from every account in the calendar month; success means Crawlbase answered with cb_status 200 and the site answered with a normal status. No sampling, no exclusions. Method

Try it

Run this recipe in the Playground with your token. Up to 5,000 free requests, no card.

Open in Playground

Run it at scale

A page of miamiherald.com costs 1 credit. Pay as you go needs no plan: 1,000,000 pages come to about $528, on a ladder that falls from $3 to $0.02 per 1,000 requests as volume grows, and you start with up to 5,000 free requests. Starter covers 200,000 pages a month for $99.

Starter · $99/mo All plans

Keep it fresh

Push your URL list to the Crawler with a cadence and a callback. It paces the requests, retries what the site refuses, and delivers every page to your endpoint or Cloud Storage.

See the Crawler

Report a break in this recipe·Suggest a site

Related recipes

Site names identify the pages a recipe fetches. Crawlbase is not affiliated with any site listed. Use recipes within the acceptable use policy.Measured numbers from August 2026, refreshed monthly