Blocklist · Amazon

Sites that block Amazonbot

2,583 of the 29,120 domains we have measured, 9%, disallow amazonbot at the site root in robots.txt. Amazonbot collects content that may be used to train a model.

Every domain here has withheld its content from Amazon's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,583 of 29,120 measured domains (9%) disallow amazonbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-08-24 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Amazonbot", measured 2026-08-24. https://crawlcensus.com/blocked/amazonbot

The list 2,583 domains

RankDomainTLDAI access score
59 roblox.com .com 58
62 msn.com .com 34
125 snapchat.com .com 63
155 gravatar.com .com 70
160 tumblr.com .com 51
190 cnn.com .com 50
193 theguardian.com .com 60
204 forbes.com .com 72
207 bbc.com .com 69
226 bbc.co.uk .uk 70
260 launchpad.net .net 46
281 nature.com .com 58
282 weather.com .com 79
457 cnbc.com .com 61
533 wired.com .com 74
535 cookielaw.org .org 74
543 patreon.com .com 60
552 usatoday.com .com 75
571 uol.com.br .br 74
621 sagepub.com .com 83
627 dailymail.co.uk .uk 62
662 cnet.com .com 75
671 lemonde.fr .fr 72
681 dailymail.com .com 62
697 kick.com .com 68
710 bandcamp.com .com 61
726 ted.com .com 63
740 mercadolivre.com.br .br 72
787 apnews.com .com 84
823 nbcnews.com .com 63
834 lefigaro.fr .fr 74
931 mercadolibre.com.ar .ar 72
941 healthline.com .com 70
955 corriere.it .it 79
980 theatlantic.com .com 79
1,019 theconversation.com .com 52
1,027 huffpost.com .com 82
1,042 spiegel.de .de 72
1,073 bfmtv.com .com 71
1,083 nypost.com .com 73
1,098 franceinfo.fr .fr 66
1,104 idnes.cz .cz 73
1,114 gsmarena.com .com 65
1,125 mercadolibre.com.mx .mx 72
1,165 mercadolibre.com .com 50
1,177 pimpbunny.com .com 61
1,189 aftonbladet.se .se 71
1,196 vnexpress.net .net 81
1,208 vg.no .no 73
1,209 dcinside.com .com 71
1,223 furaffinity.net .net 41
1,231 gazzetta.it .it 80
1,232 pandora.com .com 48
1,272 vietnam.vn .vn 77
1,273 ladepeche.fr .fr 80
1,275 huffingtonpost.com .com 82
1,286 actu.fr .fr 76
1,300 f95zone.to .to 49
1,305 dw.com .com 36
1,376 dagbladet.no .no 76
1,381 ilmeteo.it .it 80
1,409 iltalehti.fi .fi 50
1,426 crn77.com .com 56
1,430 omg10.com .com 56
1,439 toyhou.se .se 54
1,442 buzzfeed.com .com 58
1,446 ekstrabladet.dk .dk 60
1,447 hugedomains.com .com 48
1,456 eenadu.net .net 73
1,460 myinstants.com .com 61
1,484 dogdrip.net .net 61
1,501 xnxx.health .health 58
1,505 bblaa.com .com 56
1,514 255md.com .com 56
1,520 shahvani.com .com 55
1,539 bef77.com .com 56
1,548 serviporno.com .com 79
1,559 nya2.com .com 56
1,590 ey43.com .com 56
1,613 arabx.cam .cam 65
1,642 momon-ga.com .com 71
1,646 sportfilm800.com .com 51
1,677 manhwaweb.com .com 43
1,686 animanch.com .com 61
1,723 lectormangass.net .net 76
1,724 xxxhindi.to .to 73
1,729 loteriadehoy.com .com 58
1,740 xn--12c1ezaww.com .com 74
1,747 moviesda33.com .com 62
1,762 filmyzilla45.com .com 62
1,765 newsweek.com .com 68
1,790 notion.com .com 75
1,793 newyorker.com .com 71
1,819 va.gov .gov 72
1,831 zdnet.com .com 61
1,835 wikihow.com .com 72
1,847 arstechnica.com .com 72
1,872 oreilly.com .com 89
1,956 acronis.com .com 84
1,984 themoviedb.org .org 61
1,993 ign.com .com 64
2,007 notion.so .so 73
2,010 mashable.com .com 62
2,012 vinted.fr .fr 82
2,062 nba.com .com 78
2,085 medicalnewstoday.com .com 71
2,116 fliphtml5.com .com 84
2,207 imhentai.xxx .xxx 55
2,215 techradar.com .com 83
2,230 meb.gov.tr .tr 60
2,258 mparticle.com .com 57
2,299 guardian.co.uk .uk 60
2,319 tukrd.com .com 51
2,325 nrk.no .no 61
2,346 slate.com .com 80
2,374 xvideosputaria.com .com 76
2,403 porngangg.com .com 81
2,420 a2hosting.com .com 77
2,423 pcmag.com .com 65
2,508 yr.no .no 61
2,530 smh.com.au .au 69
2,538 epicsports.in .in 80
2,561 technologyreview.com .com 75
2,585 livescience.com .com 83
2,607 vildey.cfd .cfd 35
2,633 xnhau.kim .kim 54
2,636 blacktoon414.com .com 46
2,637 filmyfly.builders .builders 69
2,638 filmyfly.racing .racing 69
2,639 filmyzilla40.com .com 53
2,640 filmyzilla43.com .com 53
2,641 moviesda32.com .com 53
2,646 moviesda31.com .com 53
2,647 moviezwap.onl .onl 46
2,650 xnhau.la .la 54
2,651 olxsts.com .com 59
2,652 blacktoon410.com .com 42
2,653 blacktoon413.com .com 39
2,656 tmdb.org .org 66
2,659 theglobeandmail.com .com 56
2,691 newscientist.com .com 57
2,751 hai8g.com .com 47
2,786 chicagotribune.com .com 75
2,899 vanityfair.it .it 69
2,917 faz.net .net 76
2,951 asahi.com .com 72
2,969 today.com .com 59
2,974 thehindu.com .com 50
2,975 imageshack.us .us 29
2,989 vogue.com .com 78
3,008 bgtee.com .com 47
3,035 kir2kos.net .net 72
3,052 starmakerstudios.com .com 71
3,054 intelbras.com.br .br 52
3,082 dehasher.com .com 43
3,087 bisp.gov.pk .pk 64
3,096 ydparty04.tv .tv 66
3,116 newsbreak.com .com 84
3,154 mapquest.com .com 72
3,165 vinted.com .com 82
3,180 ay267.com .com 29
3,198 metro.co.uk .uk 56
3,286 flipboard.com .com 60
3,331 tomshardware.com .com 85
3,342 lifehacker.com .com 63
3,368 nzherald.co.nz .nz 47
3,412 blacktoon415.com .com 46
3,433 thefreedictionary.com .com 66
3,457 telstra.com .com 81
3,533 vanityfair.com .com 77
3,576 abc.es .es 81
3,588 stuff.co.nz .nz 50
3,595 politico.eu .eu 62
3,621 nydailynews.com .com 71
3,647 x-arxx.com .com 64
3,662 filmyzilla52.com .com 69
3,676 handelsblatt.com .com 78
3,681 mingky05.live .live 61
3,682 xnhau.you .you 54
3,686 moviesda34.com .com 53
3,693 blacktoon417.com .com 55
3,696 vidylee.click .click 48
3,700 moviezwap.land .land 62
3,706 xnhau.xxx .xxx 54
3,711 rexify.com.ng .ng 66
3,712 filmyzilla46.com .com 69
3,713 xnhau.bio .bio 54
3,717 ansa.it .it 80
3,730 oregonstate.edu .edu 58
3,771 yle.fi .fi 80
3,808 toyota.com .com 57
3,873 space.com .com 81
3,882 radiofrance.fr .fr 80
3,906 findagrave.com .com 60
3,916 news24.com .com 56
3,966 bostonglobe.com .com 78
4,015 reolink.com .com 81
4,065 seekingalpha.com .com 79
4,070 ilsole24ore.com .com 73
4,079 vaticannews.va .va 40
Page 1 of 13Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Amazonbot reference, the full census, and the JSON endpoint.