Websites that block Arquivo-web-crawler in the News niche

Site Stats Database tracks 579 websites that are both Arquivo-web-crawler and News, each enriched with traffic, authority, and the full detected tech stack.

They tend to have stronger authority than the typical website: their median Ahrefs Domain Rating is 66, higher than the 28 median across all sites Site Stats Database tracks.

Traffic estimates, keywords, and authority come from DataForSEO; Domain Rating comes from Ahrefs' public endpoint; and the topic, market, and technology detections come from Site Stats Database's own crawler.

Yes. The complete, filterable list of all 579 websites that block Arquivo-web-crawler in the News niche, with traffic history, authority, keywords, and the full tech stack, is available with a Site Stats Database plan.