Blocklist · Amazon

Sites that block Amazonbot

2,298 of the 29,991 domains we have measured, 8%, disallow amazonbot at the site root in robots.txt. Amazonbot collects content that may be used to train a model.

Every domain here has withheld its content from Amazon's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,298 of 29,991 measured domains (8%) disallow amazonbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Amazonbot", measured 2026-11-21. https://crawlcensus.com/blocked/amazonbot

The list 2,298 domains

RankDomainTLDAI access score
62 msn.com .com 41
155 gravatar.com .com 75
160 tumblr.com .com 41
190 cnn.com .com 50
193 theguardian.com .com 60
207 bbc.com .com 76
226 bbc.co.uk .uk 77
260 launchpad.net .net 52
281 nature.com .com 56
282 weather.com .com 86
399 aliexpress.com .com 81
457 cnbc.com .com 54
533 wired.com .com 81
535 cookielaw.org .org 75
571 uol.com.br .br 82
617 unesco.org .org 90
619 ikea.com .com 89
621 sagepub.com .com 87
627 dailymail.co.uk .uk 61
662 cnet.com .com 79
671 lemonde.fr .fr 81
681 dailymail.com .com 61
710 bandcamp.com .com 53
726 ted.com .com 70
740 mercadolivre.com.br .br 67
763 bild.de .de 81
823 nbcnews.com .com 59
834 lefigaro.fr .fr 71
931 mercadolibre.com.ar .ar 67
941 healthline.com .com 80
955 corriere.it .it 63
977 onet.pl .pl 76
983 elmundo.es .es 84
1,019 theconversation.com .com 62
1,027 huffpost.com .com 85
1,054 n-tv.de .de 88
1,056 marca.com .com 85
1,061 as.com .com 84
1,073 bfmtv.com .com 81
1,083 nypost.com .com 81
1,098 franceinfo.fr .fr 60
1,104 idnes.cz .cz 80
1,125 mercadolibre.com.mx .mx 67
1,165 mercadolibre.com .com 40
1,177 pimpbunny.com .com 56
1,189 aftonbladet.se .se 77
1,196 vnexpress.net .net 88
1,208 vg.no .no 79
1,209 dcinside.com .com 77
1,223 furaffinity.net .net 39
1,231 gazzetta.it .it 80
1,232 pandora.com .com 53
1,272 vietnam.vn .vn 74
1,273 ladepeche.fr .fr 86
1,275 huffingtonpost.com .com 85
1,286 actu.fr .fr 81
1,300 f95zone.to .to 59
1,305 dw.com .com 42
1,371 sex-studentki.team .team 57
1,376 dagbladet.no .no 74
1,381 ilmeteo.it .it 87
1,394 usnews.com .com 83
1,409 iltalehti.fi .fi 58
1,426 crn77.com .com 51
1,430 omg10.com .com 51
1,439 toyhou.se .se 52
1,442 buzzfeed.com .com 65
1,446 ekstrabladet.dk .dk 67
1,456 eenadu.net .net 67
1,484 dogdrip.net .net 52
1,501 xnxx.health .health 58
1,505 bblaa.com .com 51
1,514 255md.com .com 51
1,520 shahvani.com .com 45
1,536 theqoo.net .net 61
1,539 bef77.com .com 51
1,548 serviporno.com .com 84
1,559 nya2.com .com 51
1,590 ey43.com .com 51
1,613 arabx.cam .cam 66
1,634 sex-studentki.cafe .cafe 56
1,639 darkero.com .com 67
1,677 manhwaweb.com .com 42
1,723 lectormangass.net .net 77
1,724 xxxhindi.to .to 78
1,729 loteriadehoy.com .com 56
1,740 xn--12c1ezaww.com .com 74
1,747 moviesda33.com .com 62
1,762 filmyzilla45.com .com 62
1,790 notion.com .com 94
1,793 newyorker.com .com 73
1,831 zdnet.com .com 76
1,835 wikihow.com .com 76
1,984 themoviedb.org .org 74
1,993 ign.com .com 62
2,007 notion.so .so 93
2,010 mashable.com .com 61
2,012 vinted.fr .fr 68
2,085 medicalnewstoday.com .com 81
2,207 imhentai.xxx .xxx 51
2,215 techradar.com .com 87
2,230 meb.gov.tr .tr 66
2,299 guardian.co.uk .uk 60
2,319 tukrd.com .com 47
2,325 nrk.no .no 69
2,346 slate.com .com 80
2,348 nontondrama.my .my 77
2,374 xvideosputaria.com .com 74
2,423 pcmag.com .com 63
2,447 sendbird.com .com 89
2,508 yr.no .no 64
2,530 smh.com.au .au 82
2,541 mingky04.live .live 52
2,561 technologyreview.com .com 82
2,585 livescience.com .com 85
2,607 vildey.cfd .cfd 38
2,637 filmyfly.builders .builders 64
2,638 filmyfly.racing .racing 64
2,639 filmyzilla40.com .com 62
2,640 filmyzilla43.com .com 62
2,641 moviesda32.com .com 62
2,646 moviesda31.com .com 62
2,647 moviezwap.onl .onl 52
2,691 newscientist.com .com 76
2,723 yumpu.com .com 30
2,751 hai8g.com .com 51
2,772 ko-fi.com .com 53
2,786 chicagotribune.com .com 79
2,899 vanityfair.it .it 77
2,917 faz.net .net 39
2,969 today.com .com 62
2,974 thehindu.com .com 66
2,975 imageshack.us .us 71
2,989 vogue.com .com 82
3,008 bgtee.com .com 51
3,052 starmakerstudios.com .com 87
3,054 intelbras.com.br .br 52
3,096 ydparty04.tv .tv 86
3,165 vinted.com .com 68
3,173 esquire.com .com 75
3,180 ay267.com .com 51
3,198 metro.co.uk .uk 59
3,286 flipboard.com .com 64
3,291 cosmopolitan.com .com 79
3,295 goodhousekeeping.com .com 80
3,320 unep.org .org 71
3,331 tomshardware.com .com 87
3,342 lifehacker.com .com 65
3,368 nzherald.co.nz .nz 56
3,433 thefreedictionary.com .com 71
3,457 telstra.com .com 88
3,533 vanityfair.com .com 81
3,542 orf.at .at 69
3,576 abc.es .es 81
3,595 politico.eu .eu 62
3,608 case-battle.id .id 48
3,662 filmyzilla52.com .com 55
3,676 handelsblatt.com .com 82
3,686 moviesda34.com .com 62
3,700 moviezwap.land .land 52
3,711 rexify.com.ng .ng 59
3,712 filmyzilla46.com .com 55
3,717 ansa.it .it 85
3,730 oregonstate.edu .edu 63
3,771 yle.fi .fi 85
3,800 ebsco.com .com 65
3,808 toyota.com .com 60
3,873 space.com .com 85
3,916 news24.com .com 56
3,918 rte.ie .ie 83
3,934 menshealth.com .com 75
3,966 bostonglobe.com .com 83
4,015 reolink.com .com 86
4,061 screenrant.com .com 84
4,065 seekingalpha.com .com 91
4,070 ilsole24ore.com .com 78
4,079 vaticannews.va .va 44
4,084 uiowa.edu .edu 70
4,108 howtogeek.com .com 84
4,161 kompas.com .com 77
4,181 sbs.com.au .au 83
4,190 zoominfo.com .com 90
4,205 emojipedia.org .org 68
4,304 tvtropes.org .org 55
4,326 wiki.gg .gg 67
4,334 blender.org .org 63
4,407 20minutos.es .es 87
4,532 biorxiv.org .org 44
4,551 yna.co.kr .kr 87
4,579 srf.ch .ch 87
4,609 123rf.com .com 43
4,684 msnbc.com .com 75
4,753 xda-developers.com .com 83
4,791 collider.com .com 83
4,925 cadenaser.com .com 78
4,927 iol.co.za .za 69
4,929 onlamp.com .com 80
4,965 vinted.co.uk .uk 91
4,987 dr.dk .dk 81
5,002 mercadolibre.cl .cl 67
Page 1 of 12Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Amazonbot reference, the full census, and the JSON endpoint.