Websites that block Arquivo-web-crawler in the English market

Site Stats Database tracks 983 websites that are both Arquivo-web-crawler and English, each enriched with traffic, authority, and the full detected tech stack.

They tend to have stronger authority than the typical website: their median Ahrefs Domain Rating is 55, higher than the 28 median across all sites Site Stats Database tracks.

Traffic estimates, keywords, and authority come from DataForSEO; Domain Rating comes from Ahrefs' public endpoint; and the topic, market, and technology detections come from Site Stats Database's own crawler.

Yes. The complete, filterable list of all 983 websites that block Arquivo-web-crawler in the English market, with traffic history, authority, keywords, and the full tech stack, is available with a Site Stats Database plan.