Blocklist · Amazon

Sites that block Amazonbot

2,298 of the 29,991 domains we have measured, 8%, disallow amazonbot at the site root in robots.txt. Amazonbot collects content that may be used to train a model.

Every domain here has withheld its content from Amazon's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,298 of 29,991 measured domains (8%) disallow amazonbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Amazonbot", measured 2026-11-21. https://crawlcensus.com/blocked/amazonbot

The list 2,298 domains

RankDomainTLDAI access score
5,026 pcgamer.com .com 85
5,037 imageshack.com .com 71
5,057 deccanherald.com .com 64
5,068 gq.com .com 81
5,096 nine.com.au .au 71
5,146 everydayhealth.com .com 60
5,153 theage.com.au .au 75
5,158 mercurynews.com .com 78
5,205 lapresse.ca .ca 65
5,223 oilprice.com .com 90
5,268 ora.com .com 94
5,277 bookshop.org .org 74
5,293 turbify.com .com 85
5,297 chinatimes.com .com 64
5,323 cbr.com .com 83
5,375 mercadolibre.com.co .co 67
5,395 makeuseof.com .com 84
5,401 mediamarkt.de .de 90
5,413 expressen.se .se 61
5,455 gamerant.com .com 81
5,457 diigo.com .com 35
5,463 rainews.it .it 53
5,523 architecturaldigest.com .com 83
5,678 dn.se .se 60
5,684 theepochtimes.com .com 80
5,714 francetvinfo.fr .fr 53
5,770 boingboing.net .net 79
5,775 tv2.no .no 70
5,786 cloudpath.live .live 44
5,788 ibtimes.com .com 84
5,834 motherjones.com .com 69
5,874 hs.fi .fi 68
5,876 dmitriy-mevedev-tor.top .top 53
5,895 movieweb.com .com 84
5,912 pagesix.com .com 80
5,993 eonline.com .com 81
6,019 vinted.de .de 67
6,032 rtl.de .de 85
6,035 opaque.net .net 39
6,042 sporcle.com .com 87
6,064 delfi.lt .lt 83
6,088 futura-sciences.com .com 93
6,089 azcentral.com .com 74
6,111 ledauphine.com .com 82
6,125 denverpost.com .com 78
6,180 tf1info.fr .fr 84
6,194 ifixit.com .com 73
6,245 raiplay.it .it 55
6,246 eurogamer.net .net 57
6,275 leprogres.fr .fr 82
6,301 iata.org .org 68
6,335 royalroad.com .com 48
6,340 vinted.it .it 68
6,342 vinted.pl .pl 86
6,352 tv2.dk .dk 74
6,356 freep.com .com 73
6,361 ici.fr .fr 87
6,377 gamesradar.com .com 85
6,386 huffingtonpost.co.uk .uk 82
6,391 sex-studentki.live .live 56
6,421 chavesnamao.com.br .br 80
6,429 emol.com .com 70
6,504 telstra.com.au .au 86
6,512 telegram.com .com 73
6,513 sandiegouniontribune.com .com 78
6,530 theintercept.com .com 86
6,549 midilibre.fr .fr 86
6,557 sportingnews.com .com 82
6,587 jorudan.co.jp .jp 43
6,593 wired.co.uk .uk 64
6,609 procyclingstats.com .com 56
6,610 is.fi .fi 68
6,726 rtbf.be .be 67
6,737 altavista.com .com 53
6,793 svt.se .se 66
6,803 schwaebische.de .de 70
6,808 chunichi.co.jp .jp 71
6,816 maxroll.gg .gg 59
6,817 funnyjunk.com .com 52
6,822 elcorreo.com .com 80
6,865 illinois.gov .gov 67
6,945 countryliving.com .com 74
6,948 nicematin.com .com 77
6,988 buzzfeednews.com .com 79
7,042 cntraveler.com .com 82
7,058 playmogo.com .com 44
7,082 aktuality.sk .sk 85
7,084 spacebattles.com .com 72
7,091 kathimerini.gr .gr 68
7,106 nrc.nl .nl 84
7,109 military.com .com 84
7,118 nme.com .com 81
7,119 rp-online.de .de 79
7,127 hani.co.kr .kr 67
7,204 photoshelter.com .com 76
7,206 hentaiera.com .com 57
7,225 ygosu.com .com 64
7,247 nishinippon.co.jp .jp 69
7,268 nzz.ch .ch 76
7,275 baltimoresun.com .com 76
7,294 fakt.pl .pl 78
7,324 nordkurier.de .de 69
7,345 rpp.pe .pe 90
7,349 rae.es .es 61
7,353 hentaifox.com .com 59
7,355 bandlab.com .com 59
7,360 mathrubhumi.com .com 82
7,363 bhaskar.com .com 75
7,372 15min.lt .lt 74
7,392 delish.com .com 76
7,396 outsideonline.com .com 79
7,402 bitchute.com .com 42
7,423 jiji.com .com 81
7,427 nami.org .org 84
7,468 giallozafferano.it .it 87
7,514 biography.com .com 76
7,527 statnews.com .com 89
7,531 theonion.com .com 84
7,540 freeones.com .com 71
7,556 lindependant.fr .fr 86
7,562 nettavisen.no .no 63
7,589 brasil247.com .com 80
7,605 minkabu.jp .jp 66
7,647 sporza.be .be 87
7,659 bobaedream.co.kr .kr 76
7,692 jetpunk.com .com 46
7,738 pitchfork.com .com 81
7,745 huffingtonpost.jp .jp 78
7,821 gala.fr .fr 90
7,849 kleinezeitung.at .at 86
7,863 refinery29.com .com 78
7,882 eroprofile.com .com 63
7,937 calciomercato.com .com 81
7,947 cnnamador.com .com 74
7,981 afr.com .com 72
8,030 oceanofpdf.com .com 59
8,094 nefisyemektarifleri.com .com 76
8,100 loudecho.ai .ai 56
8,104 x-x-x.tube .tube 84
8,127 my-personaltrainer.it .it 79
8,160 javhdporn.net .net 71
8,173 leggo.it .it 62
8,193 khaleejtimes.com .com 82
8,221 tubidy.llc .llc 75
8,227 sex-studentki.sale .sale 57
8,263 hochi.news .news 78
8,268 litmarket.ru .ru 87
8,270 bestjavporn.com .com 66
8,283 americatv.com.pe .pe 89
8,287 javdock.com .com 65
8,310 psychcentral.com .com 79
8,378 revistaoeste.com .com 69
8,380 veikkaus.fi .fi 67
8,385 emojicombos.com .com 47
8,412 anikototv.to .to 62
8,436 beatport.com .com 54
8,449 sextb.net .net 62
8,450 complex.com .com 91
8,484 sciencenews.org .org 86
8,511 demonicscans.org .org 57
8,541 91porna.com .com 88
8,560 presseportal.de .de 87
8,568 kriesi.at .at 77
8,606 javdb.com .com 52
8,621 momvids.com .com 50
8,664 voetbalzone.nl .nl 81
8,675 typingtest.com .com 86
8,692 olympusxyz.com .com 56
8,721 ddnavi.com .com 72
8,789 supremevalues.com .com 70
8,793 vinted.es .es 86
8,800 sefan.ru .ru 43
8,803 libramemoria.com .com 91
8,815 olimpbet.kz .kz 44
8,830 portalsamorzadowy.pl .pl 69
8,854 nikkeibp.co.jp .jp 64
8,866 theweek.com .com 84
8,883 manhuagui.com .com 61
8,897 rynekzdrowia.pl .pl 64
8,928 nottingham.ac.uk .uk 64
8,931 camel1.tv .tv 67
8,944 pomorska.pl .pl 77
8,959 glamour.com .com 81
8,962 eboblack.com .com 89
8,984 getmodsapk.com .com 75
9,017 hentai20.io .io 69
9,051 avjb.com .com 53
9,055 porn-comic.com .com 54
9,062 bluewin.ch .ch 66
9,069 wbur.org .org 81
9,070 towardsdatascience.com .com 70
9,130 2ch2.net .net 43
9,149 forth.gr .gr 60
9,200 nekopoi.care .care 56
9,238 xxxmovies.life .life 64
9,242 zonatmo.org .org 63
9,264 aflamk1.net .net 57
9,277 hsex.tv .tv 53
9,278 dorama.land .land 77
9,285 pkok11.com .com 52
PreviousPage 2 of 12Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Amazonbot reference, the full census, and the JSON endpoint.