Blocklist · Perplexity

Sites that block PerplexityBot

1,080 of the 30,332 domains we have measured, 4%, disallow perplexitybot at the site root in robots.txt. PerplexityBot builds the index that decides whether the operator's assistant cites a page.

Every domain here has removed itself from Perplexity's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

1,080 of 30,332 measured domains (4%) disallow perplexitybot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-08-25 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block PerplexityBot", measured 2026-08-25. https://crawlcensus.com/blocked/perplexitybot

The list 1,080 domains

RankDomainTLDAI access score
5,752 sankei.com .com 76
5,775 tv2.no .no 70
5,788 ibtimes.com .com 84
5,846 runescape.wiki .wiki 82
5,874 hs.fi .fi 68
5,904 windstream.net .net 53
5,912 pagesix.com .com 80
5,948 suntimes.com .com 80
5,960 milliyet.com.tr .tr 72
5,993 eonline.com .com 74
6,004 ilmessaggero.it .it 62
6,020 giga.de .de 81
6,042 sporcle.com .com 87
6,062 nhk.jp .jp 64
6,064 delfi.lt .lt 80
6,089 azcentral.com .com 69
6,125 denverpost.com .com 79
6,159 instiz.net .net 42
6,184 nyt.com .com 65
6,228 sbnation.com .com 69
6,245 raiplay.it .it 55
6,246 eurogamer.net .net 57
6,288 vulture.com .com 71
6,308 wwd.com .com 78
6,352 tv2.dk .dk 74
6,356 freep.com .com 73
6,361 ici.fr .fr 87
6,386 huffingtonpost.co.uk .uk 82
6,396 parismatch.com .com 74
6,464 ilpost.it .it 75
6,473 sfchronicle.com .com 54
6,512 telegram.com .com 73
6,513 sandiegouniontribune.com .com 79
6,522 eater.com .com 67
6,530 theintercept.com .com 86
6,535 literotica.com .com 85
6,544 rtvslo.si .si 65
6,549 midilibre.fr .fr 86
6,554 osf.io .io 31
6,568 dhnet.be .be 83
6,578 adage.com .com 60
6,593 wired.co.uk .uk 69
6,610 is.fi .fi 68
6,726 rtbf.be .be 76
6,737 altavista.com .com 53
6,768 akakce.com .com 76
6,803 schwaebische.de .de 70
6,808 chunichi.co.jp .jp 71
6,816 maxroll.gg .gg 59
6,817 funnyjunk.com .com 52
6,822 elcorreo.com .com 82
6,869 di.se .se 51
6,887 joongang.co.kr .kr 79
6,895 togetter.com .com 73
6,948 nicematin.com .com 78
6,973 elperiodico.com .com 80
6,988 buzzfeednews.com .com 79
7,013 ntv.com.tr .tr 84
7,042 cntraveler.com .com 75
7,071 scotsman.com .com 68
7,091 kathimerini.gr .gr 60
7,106 nrc.nl .nl 85
7,118 nme.com .com 65
7,119 rp-online.de .de 63
7,178 sanspo.com .com 77
7,225 ygosu.com .com 53
7,239 gala.de .de 78
7,247 nishinippon.co.jp .jp 69
7,250 manchestereveningnews.co.uk .uk 47
7,268 nzz.ch .ch 76
7,275 baltimoresun.com .com 77
7,278 anota.ai .ai 88
7,324 nordkurier.de .de 68
7,355 bandlab.com .com 57
7,360 mathrubhumi.com .com 77
7,363 bhaskar.com .com 75
7,372 15min.lt .lt 74
7,423 jiji.com .com 81
7,432 nouvelobs.com .com 87
7,455 amazon.sg .sg 40
7,465 nationalgeographic.org .org 71
7,468 giallozafferano.it .it 87
7,469 tsn.ca .ca 82
7,510 indiewire.com .com 75
7,531 theonion.com .com 84
7,540 freeones.com .com 71
7,556 lindependant.fr .fr 86
7,562 nettavisen.no .no 63
7,647 sporza.be .be 87
7,738 pitchfork.com .com 82
7,745 huffingtonpost.jp .jp 78
7,814 fanatik.com.tr .tr 80
7,856 popsugar.com .com 75
7,862 forocoches.com .com 50
7,863 refinery29.com .com 78
7,910 ipsosinteractive.com .com 93
7,926 financialexpress.com .com 85
7,937 calciomercato.com .com 81
7,981 afr.com .com 80
8,054 bebee.com .com 90
8,094 nefisyemektarifleri.com .com 67
8,104 x-x-x.tube .tube 71
8,127 my-personaltrainer.it .it 79
8,160 javhdporn.net .net 71
8,173 leggo.it .it 62
8,263 hochi.news .news 78
8,264 france.tv .tv 64
8,287 javdock.com .com 65
8,292 walesonline.co.uk .uk 47
8,368 pussyspace.net .net 57
8,380 veikkaus.fi .fi 67
8,421 technorati.com .com 53
8,435 thecut.com .com 84
8,541 91porna.com .com 80
8,550 tokyo-sports.co.jp .jp 83
8,603 rnz.co.nz .nz 52
8,618 nap.edu .edu 68
8,664 voetbalzone.nl .nl 81
8,799 hmetro.com.my .my 44
8,800 sefan.ru .ru 43
8,821 foreignaffairs.com .com 69
8,830 portalsamorzadowy.pl .pl 69
8,854 nikkeibp.co.jp .jp 64
8,897 rynekzdrowia.pl .pl 64
8,928 nottingham.ac.uk .uk 64
8,959 glamour.com .com 81
8,995 rawstory.com .com 73
9,062 bluewin.ch .ch 65
9,070 towardsdatascience.com .com 85
9,118 bangumi.org .org 56
9,149 forth.gr .gr 60
9,285 pkok11.com .com 52
9,302 macworld.com .com 84
9,339 detroitnews.com .com 68
9,388 law.com .com 59
9,398 leckerschmecker.me .me 81
9,468 daringfireball.net .net 67
9,471 thewrap.com .com 87
9,516 todorelatos.com .com 64
9,530 prajavani.net .net 64
9,599 jsonline.com .com 73
9,677 aagag.com .com 47
9,935 tvguia.es .es 66
10,074 cope.es .es 86
10,093 sgxnifty.org .org 90
10,144 sexiveo.com .com 62
10,191 paryajlakay.com .com 45
10,345 inews.co.uk .uk 65
10,354 clicktripz.com .com 77
10,400 morgenpost.de .de 64
10,432 expansion.com .com 87
10,470 babycenter.com .com 64
10,501 ocregister.com .com 76
10,552 self.com .com 65
10,596 uptodate.com .com 30
10,621 dailystar.co.uk .uk 47
10,646 liverpoolecho.co.uk .uk 47
10,678 newspapers.com .com 48
10,680 f-droid.org .org 63
10,708 vogue.co.uk .uk 79
10,781 47news.jp .jp 67
10,826 bonappetit.com .com 83
10,885 livestrong.com .com 81
10,894 augsburger-allgemeine.de .de 81
10,913 wyborcza.pl .pl 66
10,934 huffingtonpost.fr .fr 81
11,075 myfigurecollection.net .net 45
11,102 letyshops.com .com 60
11,130 lexpress.fr .fr 84
11,154 internshala.com .com 87
11,186 centurylink.net .net 53
11,200 aftenposten.no .no 76
11,212 jdsupra.com .com 75
11,216 nola.com .com 64
11,217 businessinsider.de .de 75
11,242 teenvogue.com .com 83
11,349 posteo.de .de 67
11,358 commonsensemedia.org .org 70
11,405 svd.se .se 78
11,457 wnp.pl .pl 65
11,465 houstonchronicle.com .com 54
11,572 overheid.nl .nl 68
11,610 allure.com .com 85
11,659 abendblatt.de .de 65
11,751 dailyrecord.co.uk .uk 47
11,827 timesunion.com .com 52
11,914 thehindubusinessline.com .com 53
12,055 nbcnewyork.com .com 62
12,111 techpowerup.com .com 50
12,113 bostonherald.com .com 79
12,139 sltrib.com .com 82
12,193 theathletic.com .com 63
12,260 alternet.org .org 89
12,377 delfi.ee .ee 58
12,379 autobild.de .de 81
12,533 indystar.com .com 73
12,542 epicurious.com .com 81
12,726 lalibre.be .be 83
12,743 extremetech.com .com 64
12,799 curbed.com .com 73
PreviousPage 2 of 6Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the PerplexityBot reference, the full census, and the JSON endpoint.