Sites that block Googlebot-News
32 of the 25,276 domains we have measured, 0.1%, disallow googlebot-news at the site root in robots.txt. Googlebot-News builds the index that decides whether the operator's assistant cites a page.
Every domain here has removed itself from Google's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.
32 of 25,276 measured domains (0.1%) disallow googlebot-news at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.
Measured 2026-08-23 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.
Cite as: Crawl Census, "Sites that block Googlebot-News", measured 2026-08-23. https://crawlcensus.com/blocked/googlebot-news
The list 32 domains
| Rank | Domain | TLD | AI access score |
|---|---|---|---|
| 1,509 | programme-tv.net | .net | 86 |
| 1,754 | ad-contents.jp | .jp | 52 |
| 4,200 | disdarrummers.shop | .shop | 77 |
| 4,619 | dextrodedenda.top | .top | 77 |
| 5,123 | ixbt.com | .com | 87 |
| 5,549 | justgiving.com | .com | 60 |
| 5,597 | feinidi.com | .com | 80 |
| 6,429 | emol.com | .com | 74 |
| 7,132 | 91mobiles.com | .com | 74 |
| 7,228 | ishe88.com | .com | 80 |
| 10,172 | dyz9.top | .top | 80 |
| 14,503 | sentinelone.com | .com | 96 |
| 16,122 | page-stats.de | .de | 49 |
| 16,251 | nysed.gov | .gov | 69 |
| 17,901 | dice.com | .com | 70 |
| 20,137 | 3bb.co.th | .th | 71 |
| 20,332 | simplywall.st | .st | 69 |
| 23,458 | inveragil.com | .com | 51 |
| 25,270 | startersites.io | .io | 46 |
| 25,826 | cnnic.cn | .cn | 59 |
| 25,857 | ly.com | .com | 68 |
| 26,166 | smartprix.com | .com | 74 |
| 28,022 | direct-book.com | .com | 45 |
| 29,037 | vidal.fr | .fr | 88 |
| 29,683 | officeplus.cn | .cn | 60 |
| 30,531 | www1.ru | .ru | 91 |
| 30,868 | sosalkino.best | .best | 69 |
| 37,106 | falter.at | .at | 77 |
| 38,083 | korabli.su | .su | 59 |
| 38,384 | cagematch.net | .net | 67 |
| 38,504 | bundesarchiv.de | .de | 77 |
| 39,484 | brighteon.com | .com | 55 |
Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.
Check a specific domain
See also the Googlebot-News reference, the full census, and the JSON endpoint.