Blocklist · Perplexity

Sites that block Perplexity-User

390 of the 25,551 domains we have measured, 2%, disallow perplexity-user at the site root in robots.txt. Perplexity-User fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from Perplexity's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

Perplexity documents that this agent may ignore robots.txt, so a Disallow here records the site's stated preference rather than an enforced block.
The measurement

390 of 25,551 measured domains (2%) disallow perplexity-user at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-08-23 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Perplexity-User", measured 2026-08-23. https://crawlcensus.com/blocked/perplexity-user

The list 390 domains

RankDomainTLDAI access score
13,579 barcelona.cat .cat 69
13,660 thrillist.com .com 70
13,667 dispatch.com .com 69
13,871 ilex.by .by 59
13,879 tennessean.com .com 74
14,090 simon.com .com 35
14,398 mercadolivre.com .com 68
14,826 rockpapershotgun.com .com 58
15,030 vogue.it .it 64
15,230 mysanantonio.com .com 54
15,269 gamesindustry.biz .biz 58
15,388 mercadolibre.com.ve .ve 64
15,401 desmoinesregister.com .com 74
15,476 computerbild.de .de 81
15,557 cincinnati.com .com 74
15,586 mercadolibre.com.uy .uy 67
15,944 rtl.be .be 82
16,118 healio.com .com 69
16,253 olhardigital.com.br .br 85
16,364 nyt.net .net 65
16,564 mapgenie.io .io 59
16,814 whattoexpect.com .com 66
16,903 adn.com .com 79
17,042 northjersey.com .com 74
17,093 montrealgazette.com .com 79
17,455 twincities.com .com 82
17,469 palmbeachpost.com .com 73
17,492 ina.fr .fr 76
17,536 seattlepi.com .com 54
17,997 iacr.org .org 50
18,063 thisismoney.co.uk .uk 51
18,208 oklahoman.com .com 74
18,280 hoerzu.de .de 45
18,442 empireonline.com .com 66
18,652 cas.sk .sk 84
18,697 news-postseven.com .com 75
18,863 dailynews.com .com 81
18,867 adressa.no .no 66
18,870 scotusblog.com .com 80
18,883 courier-journal.com .com 74
19,604 xe.gr .gr 62
19,624 fukuishimbun.co.jp .jp 76
19,836 nezavisne.com .com 70
20,030 badische-zeitung.de .de 56
20,362 thedodo.com .com 70
20,364 derwesten.de .de 83
20,745 pnp.de .de 82
20,958 pressdemocrat.com .com 79
21,038 mainpost.de .de 80
21,139 ledevoir.com .com 70
22,007 vg247.com .com 58
22,028 distrowatch.com .com 44
22,365 petitesannonces.ch .ch 67
22,623 mcall.com .com 75
23,084 app.com .com 69
23,363 gazetadopovo.com.br .br 94
23,613 nordbayern.de .de 79
23,892 portableapps.com .com 57
24,014 askmen.com .com 49
24,028 canberratimes.com.au .au 72
24,102 knoxnews.com .com 69
24,141 cntraveller.com .com 82
24,190 jacksonville.com .com 74
24,233 glamourmagazine.co.uk .uk 81
24,525 zin.ru .ru 54
24,567 newspicks.com .com 86
24,593 vogue.in .in 73
24,733 humanite.fr .fr 87
24,882 uol.com .com 82
24,946 vogue.fr .fr 81
24,977 wired.it .it 83
25,048 tokyo-np.co.jp .jp 83
25,115 pilotonline.com .com 79
25,133 myrecipes.com .com 77
25,184 kompasiana.com .com 85
25,581 jeuneafrique.com .com 67
25,610 yorkshirepost.co.uk .uk 68
25,756 ctinsider.com .com 54
25,839 delawareonline.com .com 74
25,903 heraldtribune.com .com 73
25,911 arkansasonline.com .com 55
25,939 moneydj.com .com 64
26,114 democratandchronicle.com .com 73
26,567 spox.com .com 82
26,853 tallahassee.com .com 74
26,935 fd.nl .nl 73
26,949 vocus.cc .cc 73
26,963 premiumoutlets.com .com 31
27,256 amny.com .com 79
27,401 derstandard.de .de 56
27,723 geek.com .com 38
28,170 suedkurier.de .de 81
28,390 expressandstar.com .com 68
28,540 mercadolibre.com.pe .pe 67
28,616 amzn.com .com 40
28,775 vogue.de .de 66
28,794 eastbaytimes.com .com 79
28,930 championcross.jp .jp 62
29,048 gq-magazin.de .de 83
29,139 u-cursos.cl .cl 51
29,142 floridatoday.com .com 74
29,273 expressnews.com .com 54
29,402 mmafighting.com .com 68
29,499 conjur.com.br .br 66
29,549 freiepresse.de .de 86
29,553 hankookilbo.com .com 80
29,567 ctpost.com .com 54
29,821 providencejournal.com .com 73
30,074 yugipedia.com .com 62
30,196 youngchampion.jp .jp 62
30,237 clarionledger.com .com 74
30,387 bsc.es .es 56
30,443 dobrzemieszkaj.pl .pl 61
30,703 wickedlocal.com .com 75
30,773 rheinpfalz.de .de 60
30,986 commercialappeal.com .com 74
31,032 howlongtobeat.com .com 50
31,094 ad-magazin.de .de 75
31,282 vndb.org .org 60
31,352 sportsbusinessjournal.com .com 68
31,549 lohud.com .com 74
31,786 thespec.com .com 64
32,104 worldsurfleague.com .com 61
32,181 modernhealthcare.com .com 59
32,388 rgj.com .com 73
32,437 hoopshype.com .com 70
32,540 architecturaldigest.in .in 83
32,790 tatler.com .com 83
33,069 travelmath.com .com 76
33,254 aan.com .com 72
33,325 hokkaido-np.co.jp .jp 78
33,332 desertsun.com .com 74
33,493 timesfreepress.com .com 56
33,615 kauppalehti.fi .fi 64
33,671 sussexexpress.co.uk .uk 68
34,097 vogue.es .es 66
34,445 monoskop.org .org 43
34,750 mailplus.co.uk .uk 45
34,847 sydsvenskan.se .se 53
34,961 volksfreund.de .de 67
34,973 naplesnews.com .com 73
35,058 gaoding.com .com 57
35,062 dailypress.com .com 77
35,121 thestar.co.uk .uk 68
35,364 road.cc .cc 84
35,543 news-journalonline.com .com 73
35,657 shropshirestar.com .com 68
35,669 houstonpublicmedia.org .org 45
35,759 houseandgarden.co.uk .uk 81
36,187 yorkshireeveningpost.co.uk .uk 68
36,292 dailycamera.com .com 77
36,334 ytmnd.com .com 42
36,539 nd-aktuell.de .de 78
36,667 grindosaur.com .com 55
37,106 falter.at .at 77
37,367 mittelbayerische.de .de 82
37,397 mercadolibre.com.ec .ec 64
37,549 pluska.sk .sk 84
38,007 wired.jp .jp 79
38,148 news-press.com .com 73
38,257 4players.de .de 83
38,327 inforum.com .com 70
38,409 igt.com .com 49
39,022 maville.com .com 42
39,824 werstreamt.es .es 52
40,638 main-echo.de .de 64
40,796 elpasotimes.com .com 73
40,850 portsmouth.co.uk .uk 68
40,876 cntraveller.in .in 81
40,968 kontan.co.id .id 77
41,098 gqmagazine.fr .fr 75
41,368 gunbark.dev .dev 36
41,603 lci.fr .fr 84
41,647 cjonline.com .com 73
41,653 donaukurier.de .de 87
41,760 dailybreeze.com .com 80
41,826 defcon.org .org 66
41,872 vanityfair.fr .fr 75
41,918 peopleenespanol.com .com 77
41,932 santacruzsentinel.com .com 78
41,947 vogue.co.jp .jp 79
41,958 theledger.com .com 74
41,962 okinawatimes.co.jp .jp 79
42,076 iex.nl .nl 65
42,160 tcpalm.com .com 73
42,505 medietall.no .no 41
42,666 nhregister.com .com 54
43,010 baby-kingdom.com .com 60
43,207 tv4play.se .se 77
43,480 remoteok.com .com 69
43,666 tasty.co .co 79
43,986 nn.de .de 81
PreviousPage 2 of 2

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Perplexity-User reference, the full census, and the JSON endpoint.