Last updated · traffic data through Jun 2026 - refreshes automatically as new data lands.
archive.org_bot is a crawler.
2,665
Websites
2.1%
Share of tracked
#91
Rank
of 10,135
52
Median DR
1,387,917,587
Combined monthly traffic
Showing 12 of 2,665 results
2,653 more websites that block archive.org_bot are hidden. Unlock the full list.
Site Stats Database tracks 2,665 websites that block archive.org_bot. They carry a median Ahrefs Domain Rating of 52, higher than the 28 median across all tracked sites. The typical one is about 21 years old and ranks for 2,610 organic keywords. Over the last 2 months, the number we track grew 24% and their combined traffic rose 11%. Notable archive.org_bot sites include nytimes.com, cnn.com, usatoday.com. See plans and pricing.
Every figure here is based only on the 125,901 websites Site Stats Database tracks in this dimension, not the entire web.
+523 (+24%)
2026-06 → 2026-07
0.30% of tracked sites (was 0.36%)
Dimension
Top market
Top topic
Median referring domains
1,838
Median keywords
2,610
Median domain age
21 yrs
Adoption by audience size
Share of the most-visited sites we track that are websites that block archive.org_bot.
1.8%
Top 10K
176 of 10,000
0.7%
Top 100K
708 of 100,000
0.3%
All tracked
2,665 of 880,858
Monthly snapshots of the sites in this segment. A new point is added every month. Website counts move when our catalog grows; the share of tracked sites is normalized, so it only moves when the prevalence of this segment changes.
Websites
2,665
2026-06 to 2026-07
Share of tracked sites
0.30%
2026-06 to 2026-07
Combined monthly traffic
1,387,917,587
2026-06 to 2026-07
Median page count
2,216
2026-06 to 2026-07
Median referring domains
1,838
2026-06 to 2026-07
Site Stats Database tracks 2,665 websites that block archive.org_bot, enriched with full monthly traffic history, authority, keywords, referring domains, and the complete detected tech stack. Everything refreshes at least monthly.
Site Stats Database currently tracks 2,665 websites that block archive.org_bot. We detect this by analyzing each site's homepage, response headers, and DNS, then enrich every record with traffic and authority data.
By number of sites, archive.org_bot is #91 of 10,135 blocked crawlers & bots that Site Stats Database tracks.
The most common topics among them are News, Sports, and Entertainment, and they are most common in United States and Germany. The breakdowns above show the full split, based on the 2,665 we track.
They tend to have stronger authority than the typical website: the median archive.org_bot site has an Ahrefs Domain Rating of 52, higher than the 28 median across all sites Site Stats Database tracks.
Over the last 2 months, the number we track grew 24% and their combined traffic rose 11%, based on Site Stats Database's month-by-month snapshots of this group.
Traffic estimates, organic keywords, and authority come from DataForSEO; Domain Rating comes from Ahrefs' public endpoint; and the topic, market, and tech detections come from Site Stats Database's own crawler, which inspects each site's HTML, headers, DNS, and TLS certificate.
At least monthly. Traffic and rankings refresh every month, and detections refresh as sites are re-crawled, so this page always reflects the current 2,665 websites that block archive.org_bot.
Yes. The complete, filterable list of all 2,665 websites that block archive.org_bot, enriched with traffic history, authority, keywords, and the full tech stack, is available with a Site Stats Database plan.
Site Stats Database detects archive.org_bot on the websites it tracks and enriches each with traffic and authority data.
Citation
Site Stats Database. "Websites Blocking archive.org_bot." Site Stats Database, July 1, 2026. https://sitestatsdb.com/explore/blocked-bots/archive-org-bot
| English |
| 93 |
| 3,578,724 |
| 1,035,782 |
| 32 yrs |
| 110,708,925 |
| usatoday.com | English | 92 | 5,248,227 | 596,283 | 32 yrs | 110,399,781 |
| thefreedictionary.com | 87 | 3,006,711 | 128,498 | 23 yrs | 38,433,443 |
| allure.com | English | 87 | 762,314 | 109,830 | 32 yrs | 34,398,696 |
| vogue.com | English | 91 | 1,352,503 | 223,118 | 32 yrs | 31,764,987 |
| cntraveler.com | English | 88 | 1,105,752 | 94,686 | 32 yrs | 21,699,334 |
| toasttab.com | English | 92 | 1,549,057 | 93,562 | 14 yrs | 20,490,736 |
| washingtonpost.com | 93 | 1,788,026 | 806,352 | 30 yrs | 19,359,412 |
| bonappetit.com | English | 89 | 1,071,841 | 112,080 | 31 yrs | 17,616,523 |
| wired.com | English | 92 | 1,218,526 | 498,924 | 33 yrs | 15,678,681 |
| kids.kiddle.co | English | 77 | 3,066,688 | 21,068 | 11 yrs | 13,573,647 |