Sites that block Kangaroo Bot
431 of the 28,868 domains we have measured, 1%, disallow kangaroo bot at the site root in robots.txt. Kangaroo Bot collects content that may be used to train a model.
Every domain here has withheld its content from Kangaroo LLM's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.
431 of 28,868 measured domains (1%) disallow kangaroo bot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.
Measured 2026-08-24 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.
Cite as: Crawl Census, "Sites that block Kangaroo Bot", measured 2026-08-24. https://crawlcensus.com/blocked/kangaroo-bot
The list 431 domains
| Rank | Domain | TLD | AI access score |
|---|---|---|---|
| 43,207 | tv4play.se | .se | 77 |
| 43,616 | appian.com | .com | 74 |
| 43,974 | ybw.com | .com | 87 |
| 44,714 | marinij.com | .com | 79 |
| 44,807 | gofeminin.de | .de | 80 |
| 44,878 | rtvnoord.nl | .nl | 73 |
| 45,272 | rtvutrecht.nl | .nl | 73 |
| 45,316 | eumetsat.int | .int | 80 |
| 45,378 | essen-und-trinken.de | .de | 75 |
| 45,578 | chugoku-np.co.jp | .jp | 80 |
| 45,846 | amazon.jp | .jp | 40 |
| 45,905 | kob.com | .com | 84 |
| 45,989 | aftenbladet.no | .no | 78 |
| 46,231 | registerguard.com | .com | 66 |
| 46,342 | pjstar.com | .com | 66 |
| 46,360 | pnj.com | .com | 62 |
| 46,805 | omroepwest.nl | .nl | 73 |
| 46,923 | alisweb.org | .org | 31 |
| 46,939 | southwalesargus.co.uk | .uk | 69 |
| 47,166 | tu.berlin | .berlin | 64 |
| 47,173 | eurogamer.de | .de | 57 |
| 47,228 | newsandstar.co.uk | .uk | 71 |
| 47,299 | rtvdrenthe.nl | .nl | 73 |
| 47,526 | allgaeuer-zeitung.de | .de | 73 |
| 47,739 | sportler.com | .com | 64 |
| 47,796 | topekalibraries.info | .info | 38 |
| 47,884 | vcstar.com | .com | 62 |
| 47,909 | moneyweek.com | .com | 87 |
| 48,550 | argusleader.com | .com | 62 |
| 48,777 | mtv.fi | .fi | 76 |
| 48,859 | castro.fm | .fm | 67 |
| 49,194 | mailonsunday.co.uk | .uk | 57 |
Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.
Check a specific domain
See also the Kangaroo Bot reference, the full census, and the JSON endpoint.