Blocklist · Amazon

Sites that block Amazonbot

2,298 of the 29,991 domains we have measured, 8%, disallow amazonbot at the site root in robots.txt. Amazonbot collects content that may be used to train a model.

Every domain here has withheld its content from Amazon's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,298 of 29,991 measured domains (8%) disallow amazonbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Amazonbot", measured 2026-11-21. https://crawlcensus.com/blocked/amazonbot

The list 2,298 domains

RankDomainTLDAI access score
18,515 govtech.com .com 87
18,522 thenews.com.pk .pk 65
18,526 researchsquare.com .com 50
18,549 gamasutra.com .com 83
18,595 trycloudflare.com .com 52
18,687 romatoday.it .it 67
18,710 cftc.gov .gov 54
18,782 pepper.pl .pl 76
18,812 nbcphiladelphia.com .com 62
18,822 nbcdfw.com .com 33
18,859 huntshowdown.com .com 60
18,863 dailynews.com .com 76
18,867 adressa.no .no 66
18,870 scotusblog.com .com 83
18,883 courier-journal.com .com 74
18,894 courrierinternational.com .com 83
18,913 armani.com .com 87
18,964 theagenticx.ai .ai 71
18,973 fictionzone.net .net 69
18,978 dexerto.com .com 78
19,014 lovart.ai .ai 51
19,055 aftership.com .com 78
19,060 internetsociety.org .org 75
19,063 opensecrets.org .org 46
19,161 avjoy.me .me 70
19,181 comparitech.com .com 88
19,182 clickorlando.com .com 85
19,206 pseb.ac.in .in 54
19,212 sex-studentki.studio .studio 57
19,250 beatstars.com .com 51
19,272 insurancejournal.com .com 91
19,278 laowang.vip .vip 53
19,283 denik.cz .cz 77
19,284 rabota.ru .ru 80
19,291 gifyu.com .com 54
19,298 nbcmiami.com .com 60
19,312 pinayflix.uk .uk 46
19,314 milanotoday.it .it 67
19,322 oprahdaily.com .com 76
19,342 bold.dk .dk 58
19,411 clien.net .net 79
19,429 thenewstack.io .io 69
19,439 econsultancy.com .com 88
19,461 shamela.ws .ws 55
19,478 french-stream.one .one 70
19,538 xn--l3ca4b6dsc1b.com .com 77
19,563 blu-ray.com .com 69
19,564 playbill.com .com 68
19,576 moviesmod.at .at 77
19,614 daaz.com .com 43
19,624 fukuishimbun.co.jp .jp 76
19,631 spectrumlocalnews.com .com 45
19,632 coolrom.com .com 61
19,662 aagmaal.kiwi .kiwi 69
19,672 wallhaven.cc .cc 45
19,678 skymovieshd.ceo .ceo 53
19,679 eheya.net .net 86
19,690 equidia.fr .fr 65
19,696 givemesport.com .com 83
19,719 moviesda.blue .blue 56
19,738 echodnia.eu .eu 79
19,755 100crorescompany.com .com 40
19,762 desixxx.blog .blog 65
19,810 boutique1st.com .com 56
19,814 parfumo.de .de 74
19,852 taximaxim.ru .ru 69
19,860 zawya.com .com 80
19,861 meteo.gr .gr 76
19,870 gazetawroclawska.pl .pl 79
19,891 musicradar.com .com 87
19,902 kuttymovies.red .red 52
19,906 artificialintelligenceact.eu .eu 62
19,918 mkvmoviespoint.uno .uno 72
19,932 porndroids.com .com 68
19,957 9xflix.gdn .gdn 80
19,979 maxwinexch99.com .com 27
19,989 uyeshare.cc .cc 64
20,007 juraforum.de .de 52
20,030 badische-zeitung.de .de 56
20,035 plejada.pl .pl 83
20,037 flixtor.to .to 45
20,051 sinonim.org .org 59
20,152 au.int .int 63
20,158 bigdatacloud.net .net 97
20,166 skift.com .com 82
20,225 niemanlab.org .org 51
20,281 3dporndude.com .com 60
20,282 chileautos.cl .cl 68
20,310 cna.com.tw .tw 89
20,311 fuzoku.jp .jp 87
20,337 onelook.com .com 51
20,356 fmoviess.org .org 67
20,364 derwesten.de .de 83
20,580 daryo.uz .uz 76
20,644 artmajeur.com .com 83
20,673 catched.com .com 36
20,676 haufe.de .de 76
20,718 itpro.com .com 83
20,761 nlc.hu .hu 85
20,764 nto.pl .pl 79
20,825 newspulsenow.net .net 49
20,845 wnd.com .com 90
20,847 gardeningknowhow.com .com 83
20,871 lavenir.net .net 83
20,888 alibris.com .com 72
20,958 pressdemocrat.com .com 80
20,964 betsfan.com .com 59
20,981 roadandtrack.com .com 80
21,004 femina.hu .hu 82
21,016 comingsoon.net .net 74
21,021 cloudimg.io .io 89
21,030 rugbyrama.fr .fr 89
21,044 bps.org.uk .uk 66
21,139 ledevoir.com .com 70
21,161 telemagazyn.pl .pl 81
21,162 psytests.org .org 69
21,179 odibets.com .com 66
21,182 desiporn.one .one 52
21,192 technolife.com .com 90
21,220 mindat.org .org 47
21,231 epochtimes.com .com 85
21,248 happystove.com .com 58
21,263 pornobengala.com .com 72
21,267 seher.no .no 70
21,331 winbet.bg .bg 50
21,388 indiaxnxxx.com .com 67
21,428 plovdiv24.bg .bg 80
21,430 gamefa.com .com 95
21,431 thelocal.se .se 87
21,449 thisamericanlife.org .org 58
21,481 futureplc.com .com 86
21,504 designspiration.com .com 48
21,511 iccsafe.org .org 90
21,549 callescort.org .org 70
21,553 azfamily.com .com 78
21,566 whowhatwear.com .com 82
21,568 cvbankas.lt .lt 74
21,602 becekku.com .com 81
21,678 hdmaal.la .la 55
21,686 zte.com.cn .cn 61
21,704 codeigniter.com .com 43
21,706 1x-chickenroad.com .com 44
21,707 khronos.org .org 68
21,742 capfun.com .com 89
21,758 drpornofilme.com .com 79
21,786 tamilprint62.art .art 55
21,792 mysiswaplace.my .my 52
21,809 cyclingnews.com .com 85
21,816 footba11.co .co 61
21,823 desy.de .de 62
21,828 wallpaper.com .com 85
21,864 xvideosincesto.com .com 80
21,874 jadlog.com.br .br 62
21,875 dlpsgame.com .com 53
21,889 scoop.co.nz .nz 67
21,923 romspure.cc .cc 66
21,929 automobile.tn .tn 64
21,930 endnote.com .com 71
21,934 paradoxscans.com .com 76
21,961 animesalt.link .link 70
21,976 deltaexploits.gg .gg 63
21,999 dailyhive.com .com 74
22,002 uzmovi.net .net 78
22,006 bfd269.com .com 56
22,007 vg247.com .com 58
22,028 distrowatch.com .com 44
22,031 news4jax.com .com 85
22,083 g-trouve.com .com 56
22,114 onlybokep.com .com 84
22,128 niadd.com .com 55
22,201 mmsgram.com .com 74
22,216 airliners.net .net 44
22,220 servg1.net .net 35
22,230 durationmedia.net .net 61
22,256 wsrv.nl .nl 55
22,272 geograph.org.uk .uk 84
22,277 tiamanhwa.com .com 69
22,279 ldtax.gov.bd .bd 52
22,294 thepornbang.com .com 60
22,309 vinted.be .be 68
22,365 petitesannonces.ch .ch 67
22,428 gametracker.com .com 52
22,478 freakyza.co.za .za 76
22,479 ksat.com .com 85
22,503 49s.co.uk .uk 39
22,547 vipyonoslots.com .com 58
22,548 mydesihd.com .com 72
22,555 burgerpixel.net .net 56
22,557 foxaholic.com .com 58
22,569 happymod.tube .tube 76
22,583 videystream.store .store 53
22,620 multipasko.pl .pl 76
22,623 mcall.com .com 78
22,626 medicaldaily.com .com 72
22,633 mynimeku.com .com 73
22,657 believesport.com .com 56
22,666 trevts.com .com 60
22,671 slotor777.ua .ua 76
22,740 zbzoub.com .com 58
22,771 movies4u.clinic .clinic 82
PreviousPage 5 of 12Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Amazonbot reference, the full census, and the JSON endpoint.