Websites that block magpie-crawler in the English market

Site Stats Database tracks 4,703 websites that are both magpie-crawler and English, each enriched with traffic, authority, and the full detected tech stack.

They tend to have stronger authority than the typical website: their median Ahrefs Domain Rating is 37, higher than the 28 median across all sites Site Stats Database tracks.

Traffic estimates, keywords, and authority come from DataForSEO; Domain Rating comes from Ahrefs' public endpoint; and the topic, market, and technology detections come from Site Stats Database's own crawler.

Yes. The complete, filterable list of all 4,703 websites that block magpie-crawler in the English market, with traffic history, authority, keywords, and the full tech stack, is available with a Site Stats Database plan.