Blocklist · Amazon

Sites that block Amzn-SearchBot

253 of the 29,991 domains we have measured, 0.8%, disallow amzn-searchbot at the site root in robots.txt. Amzn-SearchBot builds the index that decides whether the operator's assistant cites a page.

Every domain here has removed itself from Amazon's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

253 of 29,991 measured domains (0.8%) disallow amzn-searchbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Amzn-SearchBot", measured 2026-11-21. https://crawlcensus.com/blocked/amzn-searchbot

The list 253 domains

RankDomainTLDAI access score
41,958 theledger.com .com 74
41,999 slub-dresden.de .de 71
42,076 iex.nl .nl 48
42,160 tcpalm.com .com 73
42,260 rcgroups.com .com 41
42,262 advrider.com .com 41
42,506 royallib.com .com 69
42,614 citizen-times.com .com 74
42,698 sol.no .no 74
42,919 tcrf.net .net 29
43,302 seacoastonline.com .com 69
43,659 medonet.pl .pl 84
43,983 teambelgium.net .net 59
44,026 gainesville.com .com 66
44,299 theprovince.com .com 71
44,807 gofeminin.de .de 74
44,874 news-leader.com .com 62
44,878 rtvnoord.nl .nl 73
44,968 savannahnow.com .com 64
45,002 babycentre.co.uk .uk 62
45,159 lansingstatejournal.com .com 62
45,272 rtvutrecht.nl .nl 73
45,578 chugoku-np.co.jp .jp 80
45,604 beaconjournal.com .com 66
45,680 greenvilleonline.com .com 62
45,771 larioja.com .com 83
46,033 waptrick.com .com 65
46,175 frag-christel.de .de 57
46,231 registerguard.com .com 66
46,342 pjstar.com .com 66
46,360 pnj.com .com 62
46,638 lunapic.com .com 68
46,793 quickanddirtytips.com .com 80
46,805 omroepwest.nl .nl 73
46,923 alisweb.org .org 39
46,990 fixya.com .com 43
47,173 eurogamer.de .de 57
47,299 rtvdrenthe.nl .nl 73
47,796 topekalibraries.info .info 46
47,884 vcstar.com .com 62
48,129 komputerswiat.pl .pl 82
48,380 wsls.com .com 85
48,513 airnav.com .com 53
48,550 argusleader.com .com 62
49,271 eltern.de .de 72
49,279 presstelegram.com .com 80
49,501 sj-r.com .com 64
49,574 montgomeryadvertiser.com .com 62
50,003 europeanfilmgateway.eu .eu 65
50,278 burlingtonfreepress.com .com 62
50,312 mujerhoy.com .com 80
50,933 nwaonline.com .com 73
50,982 nrtool.st .st 54
PreviousPage 2 of 2

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Amzn-SearchBot reference, the full census, and the JSON endpoint.