# Domains that disallow Kangaroo Bot in robots.txt
# agent: kangaroo bot
# generated: 2026-08-24T09:22:08.000Z
# count: 485
#
# What this count is, so it reconciles with the rate published elsewhere:
#   485 of 46446 domains with a known policy for this agent disallow it (1.0%).
#   Of those that also served a page, 451 of 30056 disallow it (1.5%).
#   https://crawlcensus.com/operator pages quote the second figure, because a site that refuses every
#   programmatic client is not evidence about AI policy. This file lists the first,
#   because a deny list must include a site whose robots.txt disallows you even when
#   its homepage did not answer our probe. Dividing this file's length by the corpus
#   size gives neither figure.
# measured by direct request, not inferred. Method: https://crawlcensus.com/methodology
# cursor: 1787467015.1473
# resume exactly here, no gap and no replay:
#   https://crawlcensus.com/agents/kangaroo-bot/changes.json?cursor=1787467015.1473
# this list is robots.txt only. Some domains additionally refuse you at the edge:
#   https://crawlcensus.com/api/v1/preflight
# licence: CC BY 4.0, attribute as "Source: Crawl Census (https://crawlcensus.com)"
01net.com
11freunde.de
15min.lt
20minutos.es
4players.de
588ku.com
aamulehti.fi
adweek.com
aftenbladet.no
aftenposten.no
aftonbladet.se
agrarheute.com
alisweb.org
allgaeuer-zeitung.de
amazon.ae
amazon.ca
amazon.co.jp
amazon.co.uk
amazon.co.za
amazon.com
amazon.com.au
amazon.com.br
amazon.com.mx
amazon.com.tr
amazon.de
amazon.eg
amazon.es
amazon.fr
amazon.ie
amazon.in
amazon.it
amazon.jp
amazon.nl
amazon.pl
amazon.sa
amazon.se
amazon.sg
amazonvideo.com
amny.com
amzn.com
androidcentral.com
anyflip.com
app.com
appian.com
archinect.com
argusleader.com
arkansasonline.com
askmen.com
augsburger-allgemeine.de
autobild.de
azcentral.com
baltimoresun.com
barcelona.cat
beaconjournal.com
bfmtv.com
bild.de
blipfoto.com
bnn.de
bntu.by
bonn.de
bostonherald.com
bournemouthecho.co.uk
brigitte.de
bsc.es
bt.no
burlingtonfreepress.com
businessinsider.de
businessinsider.es
bz-berlin.de
carter-cash.com
castro.fm
chicagotribune.com
chinatimes.com
chugoku-np.co.jp
chunichi.co.jp
cincinnati.com
cinemablend.com
cio.com
citizen-times.com
cjonline.com
clarionledger.com
cnet.com
cnn.com
commercialappeal.com
computerbild.de
computerhope.com
computerwoche.de
computerworld.com
congress.gov
conjur.com.br
courier-journal.com
courrierinternational.com
coursehero.com
creativebloq.com
csoonline.com
ctee.com.tw
cyclingnews.com
cyclingweekly.com
dailybreeze.com
dailycamera.com
dailyecho.co.uk
dailymail.co.uk
dailymail.com
dailynews.com
dailypress.com
dealereprocess.com
decanter.com
defcon.org
delawareonline.com
delfi.ee
delfi.lt
delfi.lv
democratandchronicle.com
denverpost.com
derstandard.at
derstandard.de
derwesten.de
desertsun.com
desmoinesregister.com
detroitnews.com
digitalcameraworld.com
digitaltrends.com
diretta.it
dispatch.com
dobrzemieszkaj.pl
duden.de
dwds.de
e24.no
eadt.co.uk
eastbaytimes.com
echo-news.co.uk
edp24.co.uk
elpasotimes.com
eltern.de
equidia.fr
eredmenyek.com
essen-und-trinken.de
eumetsat.int
eurogamer.de
eurogamer.net
everydayhealth.com
expresso.pt
extremetech.com
f95zone.to
faz.net
flashscore.co
flashscore.co.id
flashscore.co.uk
flashscore.co.za
flashscore.com
flashscore.com.br
flashscore.com.mx
flashscore.com.ng
flashscore.com.tr
flashscore.com.ua
flashscore.com.ve
flashscore.de
flashscore.es
flashscore.fr
flashscore.gr
flashscore.in
flashscore.mobi
flashscore.pe
flashscore.pl
flashscore.pt
flashscore.ro
flashscore.sk
flashscore.ua
flashscore.vn
flashscorekz.com
flashscoreusa.com
flipboard.com
fliphtml5.com
floridatoday.com
forth.gr
fourfourtwo.com
freep.com
furaffinity.net
futureplc.com
futurezone.de
gainesville.com
gala.de
gamesindustry.biz
gamesradar.com
gardeningknowhow.com
gds.it
geek.com
gentoo.org
glasgowtimes.co.uk
gofeminin.de
golf.com
golfmonthly.com
goop.com
govtrack.us
gp.se
greenme.it
greenvilleonline.com
grindosaur.com
guitarworld.com
gunbark.dev
hankookilbo.com
heraldo.es
heraldscotland.com
heraldtribune.com
hinative.com
hoerzu.de
homesandgardens.com
hoopshype.com
houstonpublicmedia.org
howlongtobeat.com
hs.fi
huffingtonpost.fr
huffingtonpost.it
iacr.org
idealhome.co.uk
iex.nl
ign.com
igt.com
ilex.by
ilmanifesto.it
iltalehti.fi
imageshack.com
imageshack.us
imore.com
ina.fr
indystar.com
inews.co.uk
inforum.com
infoworld.com
instiz.net
interestingengineering.com
is.fi
itpro.com
iza.ne.jp
jacksonville.com
jamanetwork.com
japantravel.com
jfklibrary.org
journaldugeek.com
jsonline.com
jtbc.co.kr
jwz.org
kentonline.co.uk
kiplinger.com
knoxnews.com
kob.com
kotaku.com
kstp.com
lancashiretelegraph.co.uk
lansingstatejournal.com
laptopmag.com
larazon.es
lastampa.it
launchpad.net
law.com
lci.fr
leckerschmecker.me
lemonde.fr
lesechos.fr
letterboxd.com
letudiant.fr
lifehacker.com
livescience.com
livescore.cz
livescore.in
livesport.com
livesport.cz
livestrong.com
lohud.com
loudersound.com
macworld.com
mailonsunday.co.uk
mailplus.co.uk
main-echo.de
mainpost.de
manager-magazin.de
mapgenie.io
marieclaire.co.uk
marieclaire.com
marinij.com
mashable.com
maxroll.gg
mbta.com
mcall.com
medpagetoday.com
mercurynews.com
metro.co.uk
miricanvas.com
moneyweek.com
monoskop.org
montgomeryadvertiser.com
mos.ru
mparticle.com
msn.com
mtv.fi
musicradar.com
myanimelist.net
naplesnews.com
ncaa.com
nd-aktuell.de
nefisyemektarifleri.com
nettavisen.no
news-journalonline.com
news-leader.com
news-postseven.com
news-press.com
newsandstar.co.uk
newscientist.com
newspapers.com
nicematin.com
niche.com
nintendo.co.jp
nintendo.com
northjersey.com
nos.nl
noticiasaominuto.com
nrc.nl
nrtool.st
nwaonline.com
nybooks.com
nydailynews.com
nzherald.co.nz
observador.pt
ocregister.com
oefb.at
oekotest.de
ohtuleht.ee
oklahoman.com
omim.org
omroepwest.nl
opinautos.com
opovo.com.br
oxfordmail.co.uk
palmbeachpost.com
pandora.com
pantone.com
parismatch.com
pcgamer.com
pcmag.com
pcworld.com
piliapp.com
pilotonline.com
pimpbunny.com
pissedconsumer.com
pjstar.com
pnj.com
politico.eu
portableapps.com
portalsamorzadowy.pl
posteo.de
postimees.ee
postype.com
premiumoutlets.com
pressdemocrat.com
presse-citron.net
presstelegram.com
primevideo.com
providencejournal.com
pubhtml5.com
realcommercial.com.au
realestate.com.au
refinery29.com
registerguard.com
repubblica.it
rezultati.com
rgj.com
rockpapershotgun.com
rtvdrenthe.nl
rtvnoord.nl
rtvutrecht.nl
rynekzdrowia.pl
sandiegouniontribune.com
sankei.com
sanspo.com
santacruzsentinel.com
savannahnow.com
scoop.co.nz
seacoastonline.com
sfstandard.com
sicnoticias.pt
simon.com
sj-r.com
slate.com
smartbrief.com
snapchat.com
soccerway.com
southwalesargus.co.uk
space.com
spiegel.de
sportler.com
startmycar.com
statesman.com
statesmanjournal.com
stimme.de
storyblocks.com
suedkurier.de
svd.se
t3.com
t3n.de
tallahassee.com
tcpalm.com
techadvisor.com
techbook.de
techradar.com
telegram.com
telegraph.co.uk
tennessean.com
tf1.fr
tf1info.fr
theanalyst.com
theargus.co.uk
theconversation.com
theepochtimes.com
theglobeandmail.com
theledger.com
themanual.com
themoviedb.org
thenational.scot
thenorthernecho.co.uk
thespec.com
thestar.com
thetelegraphandargus.co.uk
theweek.co.uk
theweek.com
thisismoney.co.uk
timesfreepress.com
tmdb.org
tokyo-np.co.jp
tomsguide.com
tomshardware.com
topekalibraries.info
toptenreviews.com
travelbook.de
trustedshops.com
trustedshops.de
tu.berlin
tv2.dk
tv4.se
tv4play.se
tvnet.lv
twincities.com
u-cursos.cl
uesp.net
ultimahora.es
unil.ch
uol.com
uol.com.br
usatoday.com
usmagazine.com
utopia.de
vcstar.com
veikkaus.fi
vermont.gov
vg.no
vg247.com
videocardz.com
vivino.com
vndb.org
vozpopuli.com
wallpaper.com
wbur.org
welt.de
werstreamt.es
whathifi.com
whattoexpect.com
whowhatwear.com
wickedlocal.com
windowscentral.com
wnp.pl
womanandhome.com
womansworld.com
worcesternews.co.uk
worldsurfleague.com
wowhead.com
wpr.org
ybw.com
ylilauta.org
yorkpress.co.uk
ytmnd.com
yugipedia.com
zakzak.co.jp
zdnet.com
zeit.de
zetaglobal.net
zin.ru