Sites that block Kangaroo Bot
433 of the 29,991 domains we have measured, 1%, disallow kangaroo bot at the site root in robots.txt. Kangaroo Bot collects content that may be used to train a model.
Every domain here has withheld its content from Kangaroo LLM's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.
433 of 29,991 measured domains (1%) disallow kangaroo bot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.
Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.
Cite as: Crawl Census, "Sites that block Kangaroo Bot", measured 2026-11-21. https://crawlcensus.com/blocked/kangaroo-bot
The list 433 domains
| Rank | Domain | TLD | AI access score |
|---|---|---|---|
| 45,905 | kob.com | .com | 84 |
| 45,989 | aftenbladet.no | .no | 78 |
| 46,231 | registerguard.com | .com | 66 |
| 46,342 | pjstar.com | .com | 66 |
| 46,360 | pnj.com | .com | 62 |
| 46,805 | omroepwest.nl | .nl | 73 |
| 46,923 | alisweb.org | .org | 39 |
| 47,299 | rtvdrenthe.nl | .nl | 73 |
| 47,526 | allgaeuer-zeitung.de | .de | 81 |
| 47,796 | topekalibraries.info | .info | 46 |
| 47,884 | vcstar.com | .com | 62 |
| 47,909 | moneyweek.com | .com | 86 |
| 48,550 | argusleader.com | .com | 62 |
| 48,777 | mtv.fi | .fi | 76 |
| 48,859 | castro.fm | .fm | 67 |
| 49,194 | mailonsunday.co.uk | .uk | 61 |
| 49,245 | startmycar.com | .com | 51 |
| 49,271 | eltern.de | .de | 72 |
| 49,279 | presstelegram.com | .com | 80 |
| 49,420 | gds.it | .it | 77 |
| 49,447 | businessinsider.es | .es | 87 |
| 49,501 | sj-r.com | .com | 64 |
| 49,574 | montgomeryadvertiser.com | .com | 62 |
| 49,925 | aamulehti.fi | .fi | 66 |
| 50,185 | miricanvas.com | .com | 89 |
| 50,278 | burlingtonfreepress.com | .com | 62 |
| 50,312 | mujerhoy.com | .com | 80 |
| 50,338 | ohtuleht.ee | .ee | 65 |
| 50,367 | blipfoto.com | .com | 57 |
| 50,520 | womansworld.com | .com | 85 |
| 50,919 | japantravel.com | .com | 79 |
| 50,933 | nwaonline.com | .com | 73 |
| 50,982 | nrtool.st | .st | 54 |
Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.
Check a specific domain
See also the Kangaroo Bot reference, the full census, and the JSON endpoint.