Blocklist · Amazon

Sites that block Amzn-User

172 of the 30,223 domains we have measured, 0.6%, disallow amzn-user at the site root in robots.txt. Amzn-User fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from Amazon's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

Amazon documents that this agent may ignore robots.txt, so a Disallow here records the site's stated preference rather than an enforced block.
The measurement

172 of 30,223 measured domains (0.6%) disallow amzn-user at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-10-07 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Amzn-User", measured 2026-10-07. https://crawlcensus.com/blocked/amzn-user

The list 172 domains

RankDomainTLDAI access score
190 cnn.com .com 50
207 bbc.com .com 77
226 bbc.co.uk .uk 78
552 usatoday.com .com 75
647 elpais.com .com 85
662 cnet.com .com 79
941 healthline.com .com 73
977 onet.pl .pl 76
1,019 theconversation.com .com 62
1,061 as.com .com 84
1,083 nypost.com .com 81
1,223 furaffinity.net .net 39
1,831 zdnet.com .com 72
1,993 ign.com .com 67
2,010 mashable.com .com 61
2,085 medicalnewstoday.com .com 78
2,659 theglobeandmail.com .com 73
3,342 lifehacker.com .com 65
3,368 nzherald.co.nz .nz 56
3,576 abc.es .es 81
4,107 thestar.com .com 64
4,161 kompas.com .com 77
4,866 channel4.com .com 56
4,925 cadenaser.com .com 83
5,146 everydayhealth.com .com 60
5,912 pagesix.com .com 80
6,089 azcentral.com .com 74
6,246 eurogamer.net .net 57
6,356 freep.com .com 73
6,396 parismatch.com .com 74
6,512 telegram.com .com 73
6,513 sandiegouniontribune.com .com 78
6,609 procyclingstats.com .com 56
6,816 maxroll.gg .gg 59
6,822 elcorreo.com .com 80
6,948 nicematin.com .com 77
7,082 aktuality.sk .sk 80
7,127 hani.co.kr .kr 58
7,239 gala.de .de 76
7,562 nettavisen.no .no 63
7,863 refinery29.com .com 75
7,981 afr.com .com 72
8,310 psychcentral.com .com 76
8,789 supremevalues.com .com 71
8,928 nottingham.ac.uk .uk 64
9,339 detroitnews.com .com 68
9,599 jsonline.com .com 73
10,009 animedekho.app .app 70
10,470 babycenter.com .com 62
10,729 businessinsider.com.pl .pl 79
10,885 livestrong.com .com 80
12,533 indystar.com .com 73
12,743 extremetech.com .com 64
13,667 dispatch.com .com 69
13,871 ilex.by .by 59
13,879 tennessean.com .com 74
14,790 bokepindo13.study .study 69
14,826 rockpapershotgun.com .com 58
15,269 gamesindustry.biz .biz 58
15,401 desmoinesregister.com .com 74
15,509 diariovasco.com .com 82
15,557 cincinnati.com .com 74
15,653 bokepbox.tv .tv 57
15,834 bokepindo13.party .party 64
16,253 olhardigital.com.br .br 85
16,377 decider.com .com 79
16,661 windfinder.com .com 84
17,042 northjersey.com .com 74
17,469 palmbeachpost.com .com 73
17,492 ina.fr .fr 76
18,208 oklahoman.com .com 74
18,280 hoerzu.de .de 45
18,442 empireonline.com .com 62
18,595 trycloudflare.com .com 52
18,799 ironman.com .com 75
18,883 courier-journal.com .com 74
19,762 desixxx.blog .blog 65
20,035 plejada.pl .pl 83
21,139 ledevoir.com .com 70
21,823 desy.de .de 62
21,988 bokepbox.co .co 57
23,084 app.com .com 69
23,892 portableapps.com .com 55
24,014 askmen.com .com 47
24,028 canberratimes.com.au .au 79
24,102 knoxnews.com .com 74
24,525 zin.ru .ru 54
24,892 eldiariomontanes.es .es 82
25,133 myrecipes.com .com 77
25,239 greatist.com .com 77
25,839 delawareonline.com .com 74
25,903 heraldtribune.com .com 73
25,911 arkansasonline.com .com 71
26,114 democratandchronicle.com .com 73
26,637 brigitte.de .de 79
26,853 tallahassee.com .com 74
27,256 amny.com .com 79
27,796 asiasociety.org .org 71
29,139 u-cursos.cl .cl 56
29,142 floridatoday.com .com 74
29,390 kompas.id .id 65
29,821 providencejournal.com .com 73
30,052 lasprovincias.es .es 82
30,237 clarionledger.com .com 74
30,703 wickedlocal.com .com 75
30,737 diariosur.es .es 82
30,928 bokepindoh.party .party 69
30,986 commercialappeal.com .com 74
31,138 ideal.es .es 82
31,549 lohud.com .com 74
31,786 thespec.com .com 64
32,388 rgj.com .com 73
32,437 hoopshype.com .com 70
32,918 laverdad.es .es 82
33,332 desertsun.com .com 74
33,493 timesfreepress.com .com 60
34,148 asianfanfics.com .com 58
34,301 stevehoffman.tv .tv 65
34,309 unionleader.com .com 63
34,973 naplesnews.com .com 73
35,543 news-journalonline.com .com 73
35,669 houstonpublicmedia.org .org 45
35,976 bokepindo13.center .center 64
36,120 elcomercio.es .es 82
38,148 news-press.com .com 73
38,409 igt.com .com 56
39,349 hoy.es .es 82
39,824 werstreamt.es .es 60
40,339 kompas.tv .tv 77
40,796 elpasotimes.com .com 73
41,368 gunbark.dev .dev 44
41,647 cjonline.com .com 73
41,958 theledger.com .com 74
42,076 iex.nl .nl 48
42,160 tcpalm.com .com 73
42,614 citizen-times.com .com 74
43,302 seacoastonline.com .com 73
43,627 tvrain.ru .ru 85
43,659 medonet.pl .pl 84
43,675 cloudorchestranova.com .com 39
44,026 gainesville.com .com 74
44,093 statesmanjournal.com .com 73
44,807 gofeminin.de .de 80
44,874 news-leader.com .com 74
44,878 rtvnoord.nl .nl 73
44,968 savannahnow.com .com 73
45,159 lansingstatejournal.com .com 74
45,272 rtvutrecht.nl .nl 73
45,378 essen-und-trinken.de .de 74
45,604 beaconjournal.com .com 74
45,680 greenvilleonline.com .com 74
45,771 larioja.com .com 84
46,231 registerguard.com .com 74
46,342 pjstar.com .com 74
46,360 pnj.com .com 74
46,805 omroepwest.nl .nl 73
47,166 tu.berlin .berlin 63
47,299 rtvdrenthe.nl .nl 73
47,796 topekalibraries.info .info 38
47,884 vcstar.com .com 73
48,129 komputerswiat.pl .pl 82
48,513 airnav.com .com 53
48,550 argusleader.com .com 74
48,682 vegamovies.catering .catering 69
48,782 bokepindo13.food .food 64
49,126 scientific.net .net 52
49,271 eltern.de .de 72
49,501 sj-r.com .com 73
49,574 montgomeryadvertiser.com .com 74
50,278 burlingtonfreepress.com .com 74
50,312 mujerhoy.com .com 77
50,933 nwaonline.com .com 73

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Amzn-User reference, the full census, and the JSON endpoint.