Head to head

cp24.com vs dogpile.com

cp24.com is more readable to AI, 81 against 63 out of 100. Both were measured with the same audit: robots.txt policy for 48 AI agents, live requests under four crawler user agents, and a JavaScript-free read of the homepage.

cp24.com 81/10081cp24.com

Scanned 15 hours ago · full report

dogpile.com 63/10063dogpile.com

Scanned 15 hours ago · full report

Where the difference is by dimension

Dimensioncp24.comdogpile.com
Reach
Whether AI crawlers and answer-engine fetchers are permitted to request the page at all. What h…
39 / 4039 / 40
Readability
Whether a fetcher that does not execute JavaScript receives the actual content, in markup an ex…
17 / 2512 / 25
Structure
Machine-readable markup that states the page's type, entities, canonical URL, and discrete fact…
16 / 207 / 20
Attribution
Signals that let an answer engine name the author, date the content, resolve the publisher, and…
4 / 151 / 15

The measurements side by side

Measurementcp24.comdogpile.com
Answer engines blocked30
Training crawlers blocked20
Refuses AI agents at the edgenono
Words of text without JavaScript1,41472
Structured datayesno
Sitemapyesno
llms.txtnono

cp24.com blocks anthropic-ai, CCBot, ChatGPT-User, GPTBot, OAI-SearchBot, PerplexityBot.

dogpile.com blocks no tracked AI crawler in robots.txt.

Compare your own site

Free, no account. To watch a competitor and get an email when their crawler policy changes, see pricing.