Blocklist · Google

Sites that block Googlebot-News

39 of the 29,991 domains we have measured, 0.1%, disallow googlebot-news at the site root in robots.txt. Googlebot-News builds the index that decides whether the operator's assistant cites a page.

Every domain here has removed itself from Google's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

39 of 29,991 measured domains (0.1%) disallow googlebot-news at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Googlebot-News", measured 2026-11-21. https://crawlcensus.com/blocked/googlebot-news

The list 39 domains

RankDomainTLDAI access score
1,509 programme-tv.net .net 91
1,754 ad-contents.jp .jp 45
4,200 disdarrummers.shop .shop 82
4,619 dextrodedenda.top .top 82
5,123 ixbt.com .com 87
5,549 justgiving.com .com 60
5,597 feinidi.com .com 82
6,429 emol.com .com 70
7,132 91mobiles.com .com 74
7,228 ishe88.com .com 82
10,172 dyz9.top .top 82
11,468 nizixun.com .com 82
14,503 sentinelone.com .com 96
16,122 page-stats.de .de 49
16,251 nysed.gov .gov 69
17,901 dice.com .com 70
20,137 3bb.co.th .th 71
23,458 inveragil.com .com 34
25,270 startersites.io .io 46
25,826 cnnic.cn .cn 58
25,857 ly.com .com 69
26,166 smartprix.com .com 74
28,022 direct-book.com .com 45
29,037 vidal.fr .fr 88
29,683 officeplus.cn .cn 60
30,868 sosalkino.best .best 69
32,125 elmercurio.com .com 43
38,083 korabli.su .su 59
38,384 cagematch.net .net 50
38,504 bundesarchiv.de .de 77
39,484 brighteon.com .com 56
43,471 forvismazars.com .com 72
44,129 eeo.cn .cn 54
45,897 worldofwarships.eu .eu 58
47,083 enpara.com .com 99
47,285 bengo4.com .com 86
48,250 ixbt.games .games 90
49,499 immovlan.be .be 59
49,713 retail.ru .ru 89

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Googlebot-News reference, the full census, and the JSON endpoint.