Blocklist · Perplexity

Sites that block PerplexityBot

1,006 of the 29,991 domains we have measured, 3%, disallow perplexitybot at the site root in robots.txt. PerplexityBot builds the index that decides whether the operator's assistant cites a page.

Every domain here has removed itself from Perplexity's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

1,006 of 29,991 measured domains (3%) disallow perplexitybot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block PerplexityBot", measured 2026-11-22. https://crawlcensus.com/blocked/perplexitybot

The list 1,006 domains

RankDomainTLDAI access score
6,513 sandiegouniontribune.com .com 78
6,522 eater.com .com 59
6,530 theintercept.com .com 86
6,535 literotica.com .com 85
6,539 astro.com .com 37
6,544 rtvslo.si .si 65
6,549 midilibre.fr .fr 86
6,554 osf.io .io 35
6,593 wired.co.uk .uk 64
6,610 is.fi .fi 68
6,726 rtbf.be .be 67
6,737 altavista.com .com 53
6,768 akakce.com .com 80
6,803 schwaebische.de .de 70
6,808 chunichi.co.jp .jp 71
6,816 maxroll.gg .gg 59
6,817 funnyjunk.com .com 52
6,822 elcorreo.com .com 80
6,895 togetter.com .com 73
6,945 countryliving.com .com 74
6,948 nicematin.com .com 77
6,988 buzzfeednews.com .com 79
7,013 ntv.com.tr .tr 84
7,042 cntraveler.com .com 82
7,084 spacebattles.com .com 72
7,091 kathimerini.gr .gr 68
7,106 nrc.nl .nl 84
7,119 rp-online.de .de 79
7,178 sanspo.com .com 77
7,225 ygosu.com .com 64
7,239 gala.de .de 76
7,247 nishinippon.co.jp .jp 69
7,250 manchestereveningnews.co.uk .uk 47
7,268 nzz.ch .ch 76
7,275 baltimoresun.com .com 76
7,324 nordkurier.de .de 69
7,363 bhaskar.com .com 75
7,372 15min.lt .lt 74
7,392 delish.com .com 76
7,423 jiji.com .com 81
7,432 nouvelobs.com .com 87
7,455 amazon.sg .sg 40
7,468 giallozafferano.it .it 87
7,469 tsn.ca .ca 82
7,510 indiewire.com .com 75
7,514 biography.com .com 76
7,531 theonion.com .com 84
7,540 freeones.com .com 71
7,556 lindependant.fr .fr 86
7,562 nettavisen.no .no 63
7,647 sporza.be .be 87
7,680 wordplays.com .com 56
7,738 pitchfork.com .com 81
7,745 huffingtonpost.jp .jp 78
7,856 popsugar.com .com 75
7,862 forocoches.com .com 59
7,863 refinery29.com .com 78
7,926 financialexpress.com .com 85
7,937 calciomercato.com .com 81
7,981 afr.com .com 72
8,054 bebee.com .com 87
8,094 nefisyemektarifleri.com .com 76
8,104 x-x-x.tube .tube 84
8,127 my-personaltrainer.it .it 79
8,160 javhdporn.net .net 71
8,173 leggo.it .it 62
8,227 sex-studentki.sale .sale 57
8,263 hochi.news .news 78
8,287 javdock.com .com 65
8,292 walesonline.co.uk .uk 47
8,380 veikkaus.fi .fi 67
8,435 thecut.com .com 84
8,541 91porna.com .com 88
8,664 voetbalzone.nl .nl 81
8,799 hmetro.com.my .my 60
8,800 sefan.ru .ru 43
8,830 portalsamorzadowy.pl .pl 69
8,854 nikkeibp.co.jp .jp 64
8,883 manhuagui.com .com 61
8,897 rynekzdrowia.pl .pl 64
8,928 nottingham.ac.uk .uk 64
8,959 glamour.com .com 81
8,995 rawstory.com .com 77
9,027 sexvid.pro .pro 73
9,062 bluewin.ch .ch 66
9,070 towardsdatascience.com .com 70
9,118 bangumi.org .org 60
9,149 forth.gr .gr 60
9,285 pkok11.com .com 52
9,339 detroitnews.com .com 68
9,350 cv666.net .net 51
9,388 law.com .com 68
9,468 daringfireball.net .net 67
9,471 thewrap.com .com 87
9,516 todorelatos.com .com 65
9,542 findnovel.net .net 64
9,677 aagag.com .com 47
9,935 tvguia.es .es 74
10,074 cope.es .es 86
10,144 sexiveo.com .com 62
10,191 paryajlakay.com .com 45
10,345 inews.co.uk .uk 67
10,400 morgenpost.de .de 81
10,432 expansion.com .com 81
10,470 babycenter.com .com 62
10,501 ocregister.com .com 80
10,552 self.com .com 68
10,596 uptodate.com .com 33
10,621 dailystar.co.uk .uk 47
10,680 f-droid.org .org 63
10,708 vogue.co.uk .uk 79
10,781 47news.jp .jp 67
10,826 bonappetit.com .com 82
10,885 livestrong.com .com 80
10,894 augsburger-allgemeine.de .de 81
10,913 wyborcza.pl .pl 66
10,934 huffingtonpost.fr .fr 81
11,102 letyshops.com .com 60
11,122 motortrend.com .com 81
11,130 lexpress.fr .fr 86
11,154 internshala.com .com 87
11,200 aftenposten.no .no 76
11,201 latercera.com .com 80
11,212 jdsupra.com .com 75
11,216 nola.com .com 64
11,217 businessinsider.de .de 76
11,242 teenvogue.com .com 82
11,349 posteo.de .de 67
11,405 svd.se .se 78
11,457 wnp.pl .pl 65
11,465 houstonchronicle.com .com 54
11,540 runnersworld.com .com 74
11,572 overheid.nl .nl 68
11,610 allure.com .com 84
11,642 fap-guru.pro .pro 56
11,657 fishki.net .net 78
11,659 abendblatt.de .de 65
11,751 dailyrecord.co.uk .uk 47
11,827 timesunion.com .com 52
11,914 thehindubusinessline.com .com 65
11,934 loksatta.com .com 85
12,055 nbcnewyork.com .com 33
12,111 techpowerup.com .com 50
12,113 bostonherald.com .com 78
12,139 sltrib.com .com 83
12,260 alternet.org .org 89
12,377 delfi.ee .ee 57
12,441 novelfire.net .net 64
12,443 thepioneerwoman.com .com 74
12,490 housebeautiful.com .com 74
12,533 indystar.com .com 73
12,542 epicurious.com .com 64
12,726 lalibre.be .be 83
12,743 extremetech.com .com 64
12,799 curbed.com .com 73
12,841 stltoday.com .com 80
13,213 hellomagazine.com .com 86
13,237 clicrbs.com.br .br 80
13,277 mix.com .com 61
13,398 gq-magazine.co.uk .uk 81
13,451 skyscrapercity.com .com 43
13,475 fotogramas.es .es 74
13,479 bnnbloomberg.ca .ca 81
13,563 stuttgarter-zeitung.de .de 71
13,579 barcelona.cat .cat 82
13,617 latribune.fr .fr 72
13,660 thrillist.com .com 70
13,667 dispatch.com .com 74
13,792 sheknows.com .com 83
13,825 heraldscotland.com .com 81
13,860 francebleu.fr .fr 87
13,871 ilex.by .by 59
13,873 rappler.com .com 80
13,879 tennessean.com .com 74
13,882 vermont.gov .gov 73
13,937 songkick.com .com 66
13,947 prevention.com .com 74
13,987 mydealz.de .de 79
14,034 lrt.lt .lt 84
14,087 diepresse.com .com 80
14,090 simon.com .com 31
14,102 elledecor.com .com 76
14,112 project-syndicate.org .org 88
14,374 delfi.lv .lv 80
14,398 mercadolivre.com .com 72
14,408 nbclosangeles.com .com 33
14,474 seiska.fi .fi 79
14,491 aerzteblatt.de .de 69
14,562 nbcchicago.com .com 62
14,606 cnnturk.com .com 86
14,612 mopo.de .de 79
14,670 hrc.org .org 83
14,733 waz.de .de 82
14,809 auto-motor-und-sport.de .de 81
14,826 rockpapershotgun.com .com 58
14,828 autotrader.ca .ca 81
14,872 mz.de .de 70
14,961 townnews.com .com 75
14,998 kino.de .de 84
15,174 pcgamesn.com .com 83
PreviousPage 2 of 6Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the PerplexityBot reference, the full census, and the JSON endpoint.