Blocklist · Kangaroo LLM

Sites that block Kangaroo Bot

433 of the 29,991 domains we have measured, 1%, disallow kangaroo bot at the site root in robots.txt. Kangaroo Bot collects content that may be used to train a model.

Every domain here has withheld its content from Kangaroo LLM's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

433 of 29,991 measured domains (1%) disallow kangaroo bot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Kangaroo Bot", measured 2026-11-21. https://crawlcensus.com/blocked/kangaroo-bot

The list 433 domains

RankDomainTLDAI access score
16,795 vozpopuli.com .com 87
16,814 whattoexpect.com .com 65
17,042 northjersey.com .com 74
17,183 semafor.com .com 72
17,455 twincities.com .com 81
17,469 palmbeachpost.com .com 73
17,492 ina.fr .fr 76
17,522 daangn.com .com 71
17,694 manager-magazin.de .de 63
17,886 agrarheute.com .com 75
17,936 cinemablend.com .com 87
18,071 flashscore.co.uk .uk 71
18,280 hoerzu.de .de 45
18,863 dailynews.com .com 76
18,883 courier-journal.com .com 74
18,894 courrierinternational.com .com 83
19,690 equidia.fr .fr 65
19,891 musicradar.com .com 87
20,081 flashscore.com.tr .tr 70
20,318 supersport.hr .hr 51
20,364 derwesten.de .de 83
20,419 01net.com .com 93
20,481 flashscore.pt .pt 72
20,718 itpro.com .com 83
20,847 gardeningknowhow.com .com 83
20,858 flashscore.vn .vn 72
20,958 pressdemocrat.com .com 80
21,038 mainpost.de .de 80
21,231 epochtimes.com .com 85
21,267 seher.no .no 70
21,481 futureplc.com .com 86
21,566 whowhatwear.com .com 82
21,809 cyclingnews.com .com 85
21,823 desy.de .de 62
21,828 wallpaper.com .com 85
21,889 scoop.co.nz .nz 67
22,596 flashscore.gr .gr 72
22,623 mcall.com .com 78
23,084 app.com .com 69
23,875 imore.com .com 81
23,964 pcwelt.de .de 78
24,014 askmen.com .com 47
24,102 knoxnews.com .com 74
24,157 whathifi.com .com 87
24,190 jacksonville.com .com 74
24,468 flashscore.de .de 71
24,525 zin.ru .ru 41
24,882 uol.com .com 82
24,892 eldiariomontanes.es .es 82
25,007 digitalcameraworld.com .com 86
25,048 tokyo-np.co.jp .jp 81
25,115 pilotonline.com .com 79
25,237 flashscorekz.com .com 70
25,653 livesport.com .com 69
25,677 flashscore.in .in 70
25,776 zinio.com .com 76
25,839 delawareonline.com .com 74
25,903 heraldtribune.com .com 73
25,911 arkansasonline.com .com 71
26,114 democratandchronicle.com .com 73
26,210 kstp.com .com 83
26,249 guitarworld.com .com 84
26,474 mbta.com .com 64
26,637 brigitte.de .de 79
26,806 golf.com .com 88
26,853 tallahassee.com .com 74
26,963 premiumoutlets.com .com 31
27,182 ultimahora.es .es 83
27,256 amny.com .com 83
27,315 fourfourtwo.com .com 84
27,401 derstandard.de .de 56
27,838 mtvuutiset.fi .fi 72
27,946 trustedshops.de .de 73
27,999 earth.com .com 80
28,170 suedkurier.de .de 81
28,320 laptopmag.com .com 87
28,573 wpr.org .org 88
28,616 amzn.com .com 40
28,678 thenational.scot .scot 81
28,792 uesp.net .net 55
28,794 eastbaytimes.com .com 79
29,115 gp.se .se 78
29,139 u-cursos.cl .cl 51
29,323 goop.com .com 66
29,390 kompas.id .id 64
29,499 conjur.com.br .br 73
29,553 hankookilbo.com .com 84
29,572 flashscore.com.mx .mx 70
29,692 piliapp.com .com 65
29,821 providencejournal.com .com 73
30,004 sfstandard.com .com 72
30,052 lasprovincias.es .es 82
30,074 yugipedia.com .com 58
30,237 clarionledger.com .com 74
30,387 bsc.es .es 37
30,443 dobrzemieszkaj.pl .pl 61
30,703 wickedlocal.com .com 75
30,737 diariosur.es .es 82
30,810 kentonline.co.uk .uk 76
30,974 techadvisor.com .com 85
30,986 commercialappeal.com .com 74
30,992 huffingtonpost.it .it 83
31,138 ideal.es .es 82
31,149 idealhome.co.uk .uk 82
31,176 edp24.co.uk .uk 79
31,282 vndb.org .org 60
31,320 lumendatabase.org .org 51
31,499 bolasport.com .com 76
31,549 lohud.com .com 74
31,638 marieclaire.co.uk .uk 84
31,786 thespec.com .com 64
32,169 journaldugeek.com .com 91
32,267 theargus.co.uk .uk 79
32,388 rgj.com .com 73
32,406 pissedconsumer.com .com 74
32,437 hoopshype.com .com 70
32,498 toptenreviews.com .com 87
32,713 opovo.com.br .br 85
32,803 oxfordmail.co.uk .uk 79
32,806 tvnet.lv .lv 79
32,918 laverdad.es .es 82
33,430 ilmanifesto.it .it 68
33,494 theanalyst.com .com 88
33,644 tv4.se .se 76
34,012 womanandhome.com .com 85
34,309 unionleader.com .com 63
34,445 monoskop.org .org 43
34,750 mailplus.co.uk .uk 44
34,973 naplesnews.com .com 73
35,062 dailypress.com .com 79
35,543 news-journalonline.com .com 73
35,955 oekotest.de .de 86
36,120 elcomercio.es .es 82
36,334 ytmnd.com .com 41
36,539 nd-aktuell.de .de 78
36,575 dailyecho.co.uk .uk 81
36,646 cyclingweekly.com .com 85
37,297 storyblocks.com .com 70
37,547 bt.no .no 77
37,821 golfmonthly.com .com 83
38,129 11freunde.de .de 58
38,148 news-press.com .com 73
38,327 inforum.com .com 70
38,409 igt.com .com 48
38,507 bournemouthecho.co.uk .uk 79
38,519 kochbar.de .de 62
38,668 stimme.de .de 72
38,876 elnortedecastilla.es .es 82
38,945 postype.com .com 81
39,206 futurezone.de .de 86
39,349 hoy.es .es 82
39,393 zakzak.co.jp .jp 72
39,824 werstreamt.es .es 59
40,317 iza.ne.jp .jp 79
40,328 bntu.by .by 80
40,339 kompas.tv .tv 76
40,512 thetelegraphandargus.co.uk .uk 78
40,638 main-echo.de .de 64
40,713 dwds.de .de 64
40,726 flashscoreusa.com .com 71
40,796 elpasotimes.com .com 73
40,874 grid.id .id 64
41,121 lancashiretelegraph.co.uk .uk 78
41,290 theweek.co.uk .uk 84
41,336 archinect.com .com 68
41,519 greenme.it .it 82
41,542 oefb.at .at 50
41,603 lci.fr .fr 84
41,647 cjonline.com .com 73
41,736 eadt.co.uk .uk 79
41,760 dailybreeze.com .com 76
41,826 defcon.org .org 66
41,958 theledger.com .com 74
42,076 iex.nl .nl 48
42,113 glasgowtimes.co.uk .uk 79
42,160 tcpalm.com .com 73
42,582 decanter.com .com 85
42,614 citizen-times.com .com 74
42,651 computerwoche.de .de 85
42,682 opinautos.com .com 52
42,698 sol.no .no 74
43,132 jtbc.co.kr .kr 70
43,207 tv4play.se .se 77
43,302 seacoastonline.com .com 69
43,605 zonerama.com .com 30
43,616 appian.com .com 77
43,974 ybw.com .com 87
44,026 gainesville.com .com 66
44,807 gofeminin.de .de 74
44,874 news-leader.com .com 62
44,878 rtvnoord.nl .nl 73
44,968 savannahnow.com .com 64
45,159 lansingstatejournal.com .com 62
45,272 rtvutrecht.nl .nl 73
45,316 eumetsat.int .int 80
45,578 chugoku-np.co.jp .jp 80
45,604 beaconjournal.com .com 66
45,680 greenvilleonline.com .com 62
45,771 larioja.com .com 83
45,846 amazon.jp .jp 40
PreviousPage 2 of 3Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Kangaroo Bot reference, the full census, and the JSON endpoint.