Head to head

lanit.ru vs smsc.ru

smsc.ru is more readable to AI, 74 against 69 out of 100. Both were measured with the same audit: robots.txt policy for 48 AI agents, live requests under four crawler user agents, and a JavaScript-free read of the homepage.

lanit.ru 69/10069lanit.ru

Scanned 5 hours ago · full report

smsc.ru 74/10074smsc.ru

Scanned 5 hours ago · full report

Where the difference is by dimension

Dimensionlanit.rusmsc.ru
Reach
Whether AI crawlers and answer-engine fetchers are permitted to request the page at all. What h…
37 / 4039 / 40
Readability
Whether a fetcher that does not execute JavaScript receives the actual content, in markup an ex…
20 / 2521 / 25
Structure
Machine-readable markup that states the page's type, entities, canonical URL, and discrete fact…
6 / 207 / 20
Attribution
Signals that let an answer engine name the author, date the content, resolve the publisher, and…
1 / 153 / 15

The measurements side by side

Measurementlanit.rusmsc.ru
Answer engines blocked20
Training crawlers blocked90
Refuses AI agents at the edgenono
Words of text without JavaScript503650
Structured datanono
Sitemapyesno
llms.txtnoyes

lanit.ru blocks anthropic-ai, Bytespider, CCBot, ChatGPT-User, cohere-ai, FacebookBot, GPTBot, ImagesiftBot, omgili, omgilibot, Scrapy, SemrushBot-OCOB.

smsc.ru blocks no tracked AI crawler in robots.txt.

Compare your own site

Free, no account. To watch a competitor and get an email when their crawler policy changes, see pricing.