Head to head

epochtimes.com vs lpibex.com

epochtimes.com is more readable to AI, 89 against 59 out of 100. Both were measured with the same audit: robots.txt policy for 48 AI agents, live requests under four crawler user agents, and a JavaScript-free read of the homepage.

epochtimes.com 89/10089epochtimes.com

Scanned 6 hours ago · full report

lpibex.com 59/10059lpibex.com

Scanned 6 hours ago · full report

Where the difference is by dimension

Dimensionepochtimes.comlpibex.com
Reach
Whether AI crawlers and answer-engine fetchers are permitted to request the page at all. What h…
38 / 4039 / 40
Readability
Whether a fetcher that does not execute JavaScript receives the actual content, in markup an ex…
24 / 2513 / 25
Structure
Machine-readable markup that states the page's type, entities, canonical URL, and discrete fact…
18 / 203 / 20
Attribution
Signals that let an answer engine name the author, date the content, resolve the publisher, and…
4 / 151 / 15

The measurements side by side

Measurementepochtimes.comlpibex.com
Answer engines blocked10
Training crawlers blocked90
Refuses AI agents at the edgenono
Words of text without JavaScript1,187137
Structured datayesno
Sitemapyesno
llms.txtnono

epochtimes.com blocks anthropic-ai, Bytespider, CCBot, cohere-ai, Diffbot, GPTBot, ImagesiftBot, Meta-ExternalAgent, omgili, omgilibot, Scrapy.

lpibex.com blocks no tracked AI crawler in robots.txt.

Compare your own site

Free, no account. To watch a competitor and get an email when their crawler policy changes, see pricing.