Blocklist · Amazon

Sites that block Amazonbot

2,674 of the 30,351 domains we have measured, 9%, disallow amazonbot at the site root in robots.txt. Amazonbot collects content that may be used to train a model.

Every domain here has withheld its content from Amazon's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,674 of 30,351 measured domains (9%) disallow amazonbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-08-25 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Amazonbot", measured 2026-08-25. https://crawlcensus.com/blocked/amazonbot

The list 2,674 domains

RankDomainTLDAI access score
26,002 t3.com .com 88
26,005 people.inc .inc 64
26,097 km.ru .ru 73
26,103 studentdoctor.net .net 91
26,108 kebirhost.com .com 70
26,114 democratandchronicle.com .com 73
26,151 vinted.at .at 85
26,155 attendanceondemand.com .com 54
26,174 discoverhongkong.com .com 35
26,225 ekathimerini.com .com 68
26,233 thenewhumanitarian.org .org 68
26,240 yogajournal.com .com 69
26,249 guitarworld.com .com 85
26,342 straightdope.com .com 76
26,379 brisbanetimes.com.au .au 75
26,400 alternatehistory.com .com 64
26,474 mbta.com .com 64
26,482 bisnis.com .com 68
26,505 astralane.io .io 77
26,508 goha.ru .ru 79
26,558 tadex.id .id 56
26,567 spox.com .com 82
26,586 sandvik.com .com 93
26,636 northropgrumman.com .com 80
26,653 bas.bg .bg 82
26,672 subscan.io .io 47
26,751 eluniverso.com .com 76
26,755 interfax.com.ua .ua 75
26,799 anobii.com .com 53
26,806 golf.com .com 88
26,842 unherd.com .com 83
26,843 additudemag.com .com 93
26,845 spin.com .com 70
26,853 tallahassee.com .com 74
26,858 bellingcat.com .com 85
26,861 geoview.info .info 64
26,874 lejsl.com .com 83
26,935 fd.nl .nl 73
26,963 premiumoutlets.com .com 31
27,001 mymrbet.com .com 80
27,042 hosting.com .com 89
27,047 thelocal.de .de 84
27,083 thesmokinggun.com .com 55
27,103 stats.fm .fm 71
27,108 marketingprofs.com .com 56
27,128 metapress.com .com 95
27,139 bookmate.com .com 54
27,159 nationaleatingdisorders.org .org 76
27,182 ultimahora.es .es 68
27,248 oreillynet.com .com 93
27,256 amny.com .com 79
27,315 fourfourtwo.com .com 85
27,357 squareblogs.net .net 51
27,361 westfalen-blatt.de .de 81
27,424 hawaiinewsnow.com .com 76
27,471 news.am .am 68
27,482 tug.org .org 44
27,553 colombiahosting.com .com 71
27,608 cortexbid.com .com 70
27,625 naacp.org .org 91
27,660 pokelike.xyz .xyz 59
27,696 staradvertiser.com .com 84
27,723 geek.com .com 38
27,737 texasattorneygeneral.gov .gov 63
27,756 beatstars.net .net 45
27,796 asiasociety.org .org 72
27,797 centrum.sk .sk 73
27,828 tabletmag.com .com 53
27,833 apotheken-umschau.de .de 72
27,843 588ku.com .com 48
27,855 msha.ke .ke 91
27,891 blogto.com .com 62
28,003 footballant.com .com 73
28,021 sr.ht .ht 55
28,047 biodiversitylibrary.org .org 52
28,074 wvdme.com .com 43
28,079 apsense.com .com 54
28,099 explained.today .today 44
28,123 dna.fr .fr 82
28,165 cdromance.org .org 67
28,177 gazette.com .com 65
28,220 icecat.se .se 78
28,226 mhc.com .com 69
28,237 zamin.uz .uz 92
28,259 libreriauniversitaria.it .it 90
28,290 icecat.dk .dk 78
28,320 laptopmag.com .com 88
28,324 eurekamag.com .com 86
28,336 cargoagent.net .net 53
28,353 techbullion.com .com 93
28,361 core77.com .com 68
28,383 lightreading.com .com 81
28,391 bloody-disgusting.com .com 71
28,480 lto.de .de 72
28,488 jsr.io .io 54
28,522 distance.to .to 60
28,540 mercadolibre.com.pe .pe 67
28,552 pwr.edu.pl .pl 77
28,573 wpr.org .org 88
28,609 t-skirt.biz .biz 56
28,626 openfoodfacts.org .org 56
28,638 makuake.com .com 55
28,642 nachrichten.at .at 82
28,676 xforum.live .live 62
28,678 thenational.scot .scot 72
28,699 vol.at .at 84
28,705 wellcomecollection.org .org 67
28,729 famelack.com .com 74
28,754 nekobt.to .to 48
28,775 vogue.de .de 66
28,792 uesp.net .net 51
28,794 eastbaytimes.com .com 79
28,868 myvolumio.org .org 32
28,935 red-dot.org .org 67
28,939 ometria.com .com 70
28,950 acronymfinder.com .com 65
28,974 vinted.se .se 86
28,996 sebokep.vip .vip 89
29,001 completesports.com .com 90
29,011 fraserinstitute.org .org 51
29,031 threadreaderapp.com .com 69
29,048 gq-magazin.de .de 83
29,063 golzu.com .com 48
29,115 gp.se .se 76
29,121 pucsp.br .br 55
29,139 u-cursos.cl .cl 51
29,142 floridatoday.com .com 74
29,156 accel.li .li 76
29,166 freakonomics.com .com 68
29,170 spinmagazine.com .com 70
29,173 tudosaladeaula.com .com 91
29,178 motor-talk.de .de 60
29,260 b-cd.app .app 45
29,313 qbittorrent.org .org 44
29,327 vinted.hu .hu 86
29,340 bunjang.co.kr .kr 62
29,390 kompas.id .id 69
29,447 artofproblemsolving.com .com 88
29,477 hsex.icu .icu 46
29,499 conjur.com.br .br 66
29,513 mindtos.com .com 68
29,529 zkillboard.com .com 77
29,549 freiepresse.de .de 86
29,553 hankookilbo.com .com 80
29,562 therarbg.com .com 52
29,587 reprap.org .org 43
29,603 governing.com .com 87
29,655 the-numbers.com .com 72
29,661 nn125.com .com 43
29,681 odt.co.nz .nz 69
29,700 gamessofun.com .com 44
29,701 thieme-connect.de .de 41
29,732 potaroo.net .net 64
29,755 indexmundi.com .com 70
29,821 providencejournal.com .com 73
29,847 pensoft.net .net 52
29,853 panxo.ai .ai 69
29,946 lareviewofbooks.org .org 52
29,980 lidovky.cz .cz 67
29,991 efhub.com .com 53
30,004 sfstandard.com .com 72
30,046 marketingweek.com .com 74
30,049 processing.org .org 52
30,052 lasprovincias.es .es 84
30,074 yugipedia.com .com 62
30,141 salesmanago.com .com 74
30,143 short.io .io 94
30,161 bostonmagazine.com .com 66
30,183 66law.cn .cn 66
30,202 serializd.com .com 56
30,237 clarionledger.com .com 74
30,288 anycubic.com .com 61
30,301 qtoon.org .org 54
30,376 getxray.app .app 56
30,387 bsc.es .es 56
30,400 click4r.com .com 71
30,443 dobrzemieszkaj.pl .pl 61
30,470 turbo.cr .cr 48
30,471 novelupdatesforum.com .com 65
30,475 smartbrief.com .com 85
30,500 routard.com .com 56
30,517 premioibest.com .com 64
30,542 onlineraceresults.com .com 66
30,573 govtschemes.in .in 74
30,586 ruanyifeng.com .com 52
30,588 streamimdb.ru .ru 66
30,592 betcha.pa .pa 72
30,597 manhwaland.land .land 34
30,619 spectrumnews1.com .com 45
30,678 xbato.co.uk .uk 71
30,681 siasat.com .com 84
30,703 wickedlocal.com .com 75
30,711 hi5.com .com 37
30,721 animasu.work .work 71
30,737 diariosur.es .es 84
30,738 fedpat.com.ar .ar 71
30,773 rheinpfalz.de .de 60
30,810 kentonline.co.uk .uk 76
30,828 bowdoin.edu .edu 71
30,847 hytale.com .com 67
PreviousPage 8 of 14Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Amazonbot reference, the full census, and the JSON endpoint.