Blocklist · Perplexity

Sites that block Perplexity-User

385 of the 24,812 domains we have measured, 2%, disallow perplexity-user at the site root in robots.txt. Perplexity-User fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from Perplexity's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

Perplexity documents that this agent may ignore robots.txt, so a Disallow here records the site's stated preference rather than an enforced block.
The measurement

385 of 24,812 measured domains (2%) disallow perplexity-user at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-08-23 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Perplexity-User", measured 2026-08-23. https://crawlcensus.com/blocked/perplexity-user

The list 385 domains

RankDomainTLDAI access score
26 amazon.com .com 40
54 tiktok.com .com 41
62 msn.com .com 34
121 amazonvideo.com .com 63
157 nytimes.com .com 65
190 cnn.com .com 50
207 bbc.com .com 69
226 bbc.co.uk .uk 70
318 amazon.co.uk .uk 33
377 amazon.de .de 33
494 amazon.co.jp .jp 33
533 wired.com .com 74
552 usatoday.com .com 75
571 uol.com.br .br 74
609 amazon.fr .fr 33
623 amazon.co.za .za 33
627 dailymail.co.uk .uk 62
635 amazon.ca .ca 33
659 amazon.in .in 33
662 cnet.com .com 75
681 dailymail.com .com 62
682 primevideo.com .com 50
706 amazon.it .it 33
725 amazon.es .es 33
740 mercadolivre.com.br .br 72
763 bild.de .de 74
800 welt.de .de 65
812 amazon.com.au .au 33
815 theverge.com .com 68
823 nbcnews.com .com 63
833 amazon.com.br .br 33
931 mercadolibre.com.ar .ar 72
980 theatlantic.com .com 79
1,019 theconversation.com .com 52
1,027 huffpost.com .com 82
1,032 amazon.com.mx .mx 34
1,073 bfmtv.com .com 71
1,098 franceinfo.fr .fr 66
1,125 mercadolibre.com.mx .mx 72
1,165 mercadolibre.com .com 50
1,223 furaffinity.net .net 41
1,275 huffingtonpost.com .com 82
1,305 dw.com .com 36
1,409 iltalehti.fi .fi 50
1,442 buzzfeed.com .com 58
1,446 ekstrabladet.dk .dk 60
1,793 newyorker.com .com 71
1,831 zdnet.com .com 61
1,847 arstechnica.com .com 72
1,984 themoviedb.org .org 61
1,993 ign.com .com 64
2,006 amazon.eg .eg 34
2,010 mashable.com .com 62
2,189 vox.com .com 68
2,423 pcmag.com .com 65
2,430 sfgate.com .com 49
2,562 zeit.de .de 71
2,656 tmdb.org .org 66
2,659 theglobeandmail.com .com 56
2,691 newscientist.com .com 57
2,786 chicagotribune.com .com 75
2,899 vanityfair.it .it 69
2,951 asahi.com .com 72
2,969 today.com .com 59
2,975 imageshack.us .us 29
2,989 vogue.com .com 78
3,116 newsbreak.com .com 84
3,198 metro.co.uk .uk 56
3,286 flipboard.com .com 60
3,335 infojobs.net .net 51
3,342 lifehacker.com .com 63
3,368 nzherald.co.nz .nz 47
3,371 nymag.com .com 71
3,499 amazon.se .se 37
3,520 amazon.ae .ae 38
3,524 chron.com .com 54
3,533 vanityfair.com .com 77
3,595 politico.eu .eu 62
3,598 amazon.nl .nl 37
3,621 nydailynews.com .com 71
4,065 seekingalpha.com .com 79
4,070 ilsole24ore.com .com 73
4,097 amazon.pl .pl 37
4,107 thestar.com .com 60
4,161 kompas.com .com 80
4,240 amazon.sa .sa 38
4,333 derstandard.at .at 53
4,512 amazon.com.tr .tr 37
4,553 20minutes.fr .fr 67
4,925 cadenaser.com .com 78
4,987 dr.dk .dk 76
5,002 mercadolibre.cl .cl 68
5,037 imageshack.com .com 29
5,057 deccanherald.com .com 60
5,068 gq.com .com 77
5,146 everydayhealth.com .com 57
5,158 mercurynews.com .com 75
5,205 lapresse.ca .ca 62
5,251 dallasnews.com .com 50
5,375 mercadolibre.com.co .co 64
5,413 expressen.se .se 58
5,416 gentoo.org .org 57
5,523 architecturaldigest.com .com 78
5,547 amazon.ie .ie 40
5,678 dn.se .se 63
5,714 francetvinfo.fr .fr 62
5,722 hola.com .com 89
5,752 sankei.com .com 76
5,775 tv2.no .no 70
5,874 hs.fi .fi 68
6,089 azcentral.com .com 69
6,125 denverpost.com .com 79
6,159 instiz.net .net 42
6,180 tf1info.fr .fr 84
6,184 nyt.com .com 65
6,228 sbnation.com .com 69
6,246 eurogamer.net .net 57
6,288 vulture.com .com 71
6,352 tv2.dk .dk 74
6,356 freep.com .com 73
6,386 huffingtonpost.co.uk .uk 82
6,473 sfchronicle.com .com 54
6,512 telegram.com .com 73
6,513 sandiegouniontribune.com .com 79
6,522 eater.com .com 67
6,544 rtvslo.si .si 65
6,578 adage.com .com 60
6,593 wired.co.uk .uk 69
6,610 is.fi .fi 68
6,808 chunichi.co.jp .jp 71
6,816 maxroll.gg .gg 59
6,869 di.se .se 51
6,948 nicematin.com .com 78
6,988 buzzfeednews.com .com 79
7,042 cntraveler.com .com 75
7,071 scotsman.com .com 68
7,106 nrc.nl .nl 85
7,119 rp-online.de .de 63
7,247 nishinippon.co.jp .jp 69
7,268 nzz.ch .ch 76
7,275 baltimoresun.com .com 77
7,363 bhaskar.com .com 75
7,372 15min.lt .lt 74
7,423 jiji.com .com 81
7,455 amazon.sg .sg 40
7,562 nettavisen.no .no 63
7,734 tf1.fr .fr 70
7,738 pitchfork.com .com 82
7,745 huffingtonpost.jp .jp 78
7,856 popsugar.com .com 75
7,863 refinery29.com .com 78
7,937 calciomercato.com .com 81
7,981 afr.com .com 80
8,263 hochi.news .news 78
8,380 veikkaus.fi .fi 67
8,435 thecut.com .com 84
8,550 tokyo-sports.co.jp .jp 83
8,603 rnz.co.nz .nz 52
8,664 voetbalzone.nl .nl 81
8,830 portalsamorzadowy.pl .pl 69
8,854 nikkeibp.co.jp .jp 64
8,897 rynekzdrowia.pl .pl 64
8,928 nottingham.ac.uk .uk 64
8,959 glamour.com .com 81
9,062 bluewin.ch .ch 65
9,339 detroitnews.com .com 68
9,388 law.com .com 59
9,398 leckerschmecker.me .me 81
9,471 thewrap.com .com 87
9,530 prajavani.net .net 64
9,599 jsonline.com .com 73
10,074 cope.es .es 86
10,345 inews.co.uk .uk 65
10,470 babycenter.com .com 64
10,501 ocregister.com .com 76
10,552 self.com .com 65
10,678 newspapers.com .com 48
10,708 vogue.co.uk .uk 79
10,781 47news.jp .jp 67
10,826 bonappetit.com .com 83
10,885 livestrong.com .com 81
10,894 augsburger-allgemeine.de .de 81
11,102 letyshops.com .com 60
11,217 businessinsider.de .de 75
11,242 teenvogue.com .com 83
11,457 wnp.pl .pl 65
11,465 houstonchronicle.com .com 54
11,610 allure.com .com 85
11,827 timesunion.com .com 52
12,111 techpowerup.com .com 50
12,113 bostonherald.com .com 79
12,379 autobild.de .de 81
12,533 indystar.com .com 73
12,542 epicurious.com .com 81
12,743 extremetech.com .com 64
12,799 curbed.com .com 73
13,018 uwm.edu .edu 91
13,213 hellomagazine.com .com 89
13,277 mix.com .com 67
13,398 gq-magazine.co.uk .uk 82
Page 1 of 2Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Perplexity-User reference, the full census, and the JSON endpoint.