Head to head

twz.com vs kantar.com

twz.com is more readable to AI, 89 against 69 out of 100. Both were measured with the same audit: robots.txt policy for 48 AI agents, live requests under four crawler user agents, and a JavaScript-free read of the homepage.

twz.com 89/10089twz.com

Scanned 11 minutes ago · full report

kantar.com 69/10069kantar.com

Scanned 4 hours ago · full report

Where the difference is by dimension

Dimensiontwz.comkantar.com
Reach
Whether AI crawlers and answer-engine fetchers are permitted to request the page at all, in rob…
39 / 4040 / 40
Readability
Whether a fetcher that does not execute JavaScript receives the actual content, in markup an ex…
23 / 2522 / 25
Structure
Machine-readable markup that states the page's type, entities, canonical URL, and discrete fact…
20 / 206 / 20
Attribution
Signals that let an answer engine name the author, date the content, resolve the publisher, and…
7 / 151 / 15

The measurements side by side

Measurementtwz.comkantar.com
Answer engines blocked00
Training crawlers blocked00
Refuses AI agents at the edgeyesno
Words of text without JavaScript2,485616
Structured datayesno
Sitemapyesyes
llms.txtnono

twz.com blocks no tracked AI crawler in robots.txt.

kantar.com blocks no tracked AI crawler in robots.txt.

Compare your own site

Free, no account. To watch a competitor and get an email when their crawler policy changes, see pricing.