Websites that block Screaming Frog SEO Spider in the English market

Site Stats Database tracks 504 websites that are both Screaming Frog SEO Spider and English, each enriched with traffic, authority, and the full detected tech stack.

They tend to have stronger authority than the typical website: their median Ahrefs Domain Rating is 37, higher than the 28 median across all sites Site Stats Database tracks.

Traffic estimates, keywords, and authority come from DataForSEO; Domain Rating comes from Ahrefs' public endpoint; and the topic, market, and technology detections come from Site Stats Database's own crawler.

Yes. The complete, filterable list of all 504 websites that block Screaming Frog SEO Spider in the English market, with traffic history, authority, keywords, and the full tech stack, is available with a Site Stats Database plan.