Blocklist · Amazon

Sites that block Amzn-User

208 of the 29,991 domains we have measured, 0.7%, disallow amzn-user at the site root in robots.txt. Amzn-User fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from Amazon's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

Amazon documents that this agent may ignore robots.txt, so a Disallow here records the site's stated preference rather than an enforced block.
The measurement

208 of 29,991 measured domains (0.7%) disallow amzn-user at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Amzn-User", measured 2026-11-21. https://crawlcensus.com/blocked/amzn-user

The list 208 domains

RankDomainTLDAI access score
190 cnn.com .com 50
207 bbc.com .com 76
226 bbc.co.uk .uk 77
662 cnet.com .com 79
941 healthline.com .com 80
977 onet.pl .pl 76
1,019 theconversation.com .com 62
1,061 as.com .com 84
1,083 nypost.com .com 81
1,098 franceinfo.fr .fr 60
1,223 furaffinity.net .net 39
1,376 dagbladet.no .no 74
1,639 darkero.com .com 67
1,831 zdnet.com .com 76
1,993 ign.com .com 62
2,010 mashable.com .com 61
2,084 justice.gov .gov 54
2,085 medicalnewstoday.com .com 81
2,348 nontondrama.my .my 77
2,423 pcmag.com .com 63
3,342 lifehacker.com .com 65
3,368 nzherald.co.nz .nz 56
3,576 abc.es .es 81
4,161 kompas.com .com 77
4,866 channel4.com .com 56
4,925 cadenaser.com .com 78
5,146 everydayhealth.com .com 60
5,457 diigo.com .com 35
5,678 dn.se .se 60
5,714 francetvinfo.fr .fr 53
5,912 pagesix.com .com 80
6,089 azcentral.com .com 74
6,246 eurogamer.net .net 57
6,356 freep.com .com 73
6,512 telegram.com .com 73
6,513 sandiegouniontribune.com .com 78
6,609 procyclingstats.com .com 56
6,816 maxroll.gg .gg 59
6,822 elcorreo.com .com 80
6,948 nicematin.com .com 77
7,082 aktuality.sk .sk 85
7,127 hani.co.kr .kr 67
7,239 gala.de .de 76
7,294 fakt.pl .pl 78
7,562 nettavisen.no .no 63
7,863 refinery29.com .com 78
7,981 afr.com .com 72
8,030 oceanofpdf.com .com 59
8,310 psychcentral.com .com 79
8,449 sextb.net .net 62
8,606 javdb.com .com 52
8,789 supremevalues.com .com 70
8,928 nottingham.ac.uk .uk 64
9,339 detroitnews.com .com 68
9,542 findnovel.net .net 64
10,470 babycenter.com .com 62
10,729 businessinsider.com.pl .pl 79
10,885 livestrong.com .com 80
12,441 novelfire.net .net 64
12,533 indystar.com .com 73
12,743 extremetech.com .com 64
13,667 dispatch.com .com 74
13,871 ilex.by .by 59
13,879 tennessean.com .com 74
14,826 rockpapershotgun.com .com 58
14,873 rareanimes.mov .mov 72
15,269 gamesindustry.biz .biz 57
15,401 desmoinesregister.com .com 74
15,509 diariovasco.com .com 82
15,557 cincinnati.com .com 74
16,103 dweb.link .link 65
16,209 ipfs.io .io 65
16,256 runnerspace.com .com 47
16,377 decider.com .com 79
16,564 mapgenie.io .io 59
16,661 windfinder.com .com 84
16,664 lightningmaps.org .org 51
16,814 whattoexpect.com .com 65
17,042 northjersey.com .com 74
17,420 jsbin.com .com 53
17,469 palmbeachpost.com .com 73
17,492 ina.fr .fr 76
17,833 novelphoenix.com .com 61
17,886 agrarheute.com .com 75
18,280 hoerzu.de .de 45
18,309 mans.io .io 60
18,442 empireonline.com .com 62
18,522 thenews.com.pk .pk 65
18,595 trycloudflare.com .com 52
18,799 ironman.com .com 75
18,883 courier-journal.com .com 74
19,312 pinayflix.uk .uk 46
19,762 desixxx.blog .blog 65
20,035 plejada.pl .pl 83
21,139 ledevoir.com .com 70
21,267 seher.no .no 70
21,823 desy.de .de 62
22,007 vg247.com .com 58
23,084 app.com .com 69
23,157 mlnba.fun .fun 54
23,298 fuegodevida.com .com 58
24,014 askmen.com .com 47
24,028 canberratimes.com.au .au 79
24,102 knoxnews.com .com 74
24,190 jacksonville.com .com 74
24,525 zin.ru .ru 41
24,853 nameswriter.com .com 48
24,892 eldiariomontanes.es .es 82
25,133 myrecipes.com .com 77
25,239 greatist.com .com 80
25,839 delawareonline.com .com 74
25,903 heraldtribune.com .com 73
25,911 arkansasonline.com .com 71
26,114 democratandchronicle.com .com 73
26,637 brigitte.de .de 79
26,853 tallahassee.com .com 74
27,113 in3x.net .net 38
27,256 amny.com .com 83
27,723 geek.com .com 38
27,796 asiasociety.org .org 67
28,377 menuweb.menu .menu 69
28,895 weatheronline.co.uk .uk 47
29,139 u-cursos.cl .cl 51
29,341 geometrylitepc.io .io 70
29,390 kompas.id .id 64
29,477 hsex.icu .icu 63
29,821 providencejournal.com .com 73
30,052 lasprovincias.es .es 82
30,074 yugipedia.com .com 58
30,237 clarionledger.com .com 74
30,703 wickedlocal.com .com 75
30,737 diariosur.es .es 82
30,986 commercialappeal.com .com 74
31,032 howlongtobeat.com .com 49
31,138 ideal.es .es 82
31,320 lumendatabase.org .org 51
31,499 bolasport.com .com 76
31,549 lohud.com .com 74
31,786 thespec.com .com 64
31,799 wefut.com .com 50
32,388 rgj.com .com 73
32,437 hoopshype.com .com 70
32,918 laverdad.es .es 82
33,915 b254.com .com 54
34,148 asianfanfics.com .com 58
34,236 welib.st .st 47
34,301 stevehoffman.tv .tv 65
34,309 unionleader.com .com 63
34,973 naplesnews.com .com 73
35,543 news-journalonline.com .com 73
36,120 elcomercio.es .es 82
36,436 liquor.com .com 77
36,778 cwmars.org .org 43
37,700 rutracker.net .net 43
38,148 news-press.com .com 73
38,327 inforum.com .com 70
38,409 igt.com .com 48
38,814 mas.to .to 31
38,876 elnortedecastilla.es .es 82
39,349 hoy.es .es 82
39,824 werstreamt.es .es 59
40,339 kompas.tv .tv 76
40,796 elpasotimes.com .com 73
40,874 grid.id .id 64
41,647 cjonline.com .com 73
41,958 theledger.com .com 74
42,076 iex.nl .nl 48
42,160 tcpalm.com .com 73
42,614 citizen-times.com .com 74
42,698 sol.no .no 74
42,919 tcrf.net .net 29
43,302 seacoastonline.com .com 69
43,627 tvrain.ru .ru 84
43,659 medonet.pl .pl 84
44,026 gainesville.com .com 66
44,807 gofeminin.de .de 74
44,874 news-leader.com .com 62
44,878 rtvnoord.nl .nl 73
44,928 wgt.com .com 80
44,968 savannahnow.com .com 64
45,002 babycentre.co.uk .uk 62
45,159 lansingstatejournal.com .com 62
45,272 rtvutrecht.nl .nl 73
45,604 beaconjournal.com .com 66
45,680 greenvilleonline.com .com 62
45,771 larioja.com .com 83
46,231 registerguard.com .com 66
46,301 redcafe.net .net 64
46,342 pjstar.com .com 66
46,360 pnj.com .com 62
46,805 omroepwest.nl .nl 73
46,923 alisweb.org .org 39
47,173 eurogamer.de .de 57
47,299 rtvdrenthe.nl .nl 73
47,796 topekalibraries.info .info 46
47,884 vcstar.com .com 62
48,129 komputerswiat.pl .pl 82
48,513 airnav.com .com 53
48,550 argusleader.com .com 62
48,613 theoutdoorstrader.com .com 52
Page 1 of 2Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Amzn-User reference, the full census, and the JSON endpoint.