Blocklist · Perplexity

Sites that block PerplexityBot

1,006 of the 29,991 domains we have measured, 3%, disallow perplexitybot at the site root in robots.txt. PerplexityBot builds the index that decides whether the operator's assistant cites a page.

Every domain here has removed itself from Perplexity's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

1,006 of 29,991 measured domains (3%) disallow perplexitybot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block PerplexityBot", measured 2026-11-22. https://crawlcensus.com/blocked/perplexitybot

The list 1,006 domains

RankDomainTLDAI access score
26 amazon.com .com 40
54 tiktok.com .com 49
58 yahoo.com .com 67
62 msn.com .com 41
121 amazonvideo.com .com 55
190 cnn.com .com 50
193 theguardian.com .com 60
207 bbc.com .com 76
217 t-online.de .de 84
226 bbc.co.uk .uk 77
260 launchpad.net .net 52
281 nature.com .com 56
318 amazon.co.uk .uk 40
377 amazon.de .de 40
457 cnbc.com .com 54
494 amazon.co.jp .jp 40
533 wired.com .com 81
543 patreon.com .com 62
571 uol.com.br .br 82
609 amazon.fr .fr 40
623 amazon.co.za .za 40
627 dailymail.co.uk .uk 61
635 amazon.ca .ca 40
659 amazon.in .in 40
662 cnet.com .com 79
681 dailymail.com .com 61
682 primevideo.com .com 71
706 amazon.it .it 40
725 amazon.es .es 40
740 mercadolivre.com.br .br 67
763 bild.de .de 81
812 amazon.com.au .au 40
815 theverge.com .com 77
823 nbcnews.com .com 59
833 amazon.com.br .br 40
931 mercadolibre.com.ar .ar 67
942 repubblica.it .it 85
955 corriere.it .it 63
983 elmundo.es .es 84
1,017 pbs.org .org 86
1,019 theconversation.com .com 62
1,024 garmin.com .com 69
1,027 huffpost.com .com 85
1,032 amazon.com.mx .mx 40
1,056 marca.com .com 85
1,061 as.com .com 84
1,073 bfmtv.com .com 81
1,083 nypost.com .com 81
1,098 franceinfo.fr .fr 60
1,104 idnes.cz .cz 80
1,105 cookpad.com .com 73
1,125 mercadolibre.com.mx .mx 67
1,165 mercadolibre.com .com 40
1,177 pimpbunny.com .com 56
1,189 aftonbladet.se .se 77
1,208 vg.no .no 79
1,209 dcinside.com .com 77
1,223 furaffinity.net .net 39
1,258 abc.net.au .au 87
1,273 ladepeche.fr .fr 86
1,275 huffingtonpost.com .com 85
1,286 actu.fr .fr 81
1,300 f95zone.to .to 59
1,305 dw.com .com 42
1,353 sexvid.xxx .xxx 73
1,355 iqiyi.com .com 61
1,371 sex-studentki.team .team 57
1,376 dagbladet.no .no 74
1,378 aljazeera.com .com 89
1,394 usnews.com .com 83
1,409 iltalehti.fi .fi 58
1,442 buzzfeed.com .com 65
1,446 ekstrabladet.dk .dk 67
1,456 eenadu.net .net 67
1,634 sex-studentki.cafe .cafe 56
1,715 sexvid1.com .com 73
1,723 lectormangass.net .net 77
1,793 newyorker.com .com 73
1,831 zdnet.com .com 76
1,835 wikihow.com .com 76
1,856 scientificamerican.com .com 82
1,984 themoviedb.org .org 74
1,993 ign.com .com 62
2,006 amazon.eg .eg 40
2,010 mashable.com .com 61
2,115 mirror.co.uk .uk 47
2,118 variety.com .com 80
2,230 meb.gov.tr .tr 66
2,299 guardian.co.uk .uk 60
2,325 nrk.no .no 69
2,370 umd.edu .edu 88
2,423 pcmag.com .com 63
2,430 sfgate.com .com 54
2,433 express.co.uk .uk 48
2,508 yr.no .no 64
2,530 smh.com.au .au 82
2,561 technologyreview.com .com 82
2,581 hollywoodreporter.com .com 79
2,691 newscientist.com .com 76
2,723 yumpu.com .com 30
2,786 chicagotribune.com .com 79
2,822 indianexpress.com .com 85
2,880 sueddeutsche.de .de 71
2,899 vanityfair.it .it 77
2,917 faz.net .net 39
2,969 today.com .com 62
2,971 prokerala.com .com 81
2,974 thehindu.com .com 66
2,989 vogue.com .com 82
3,109 ctvnews.ca .ca 82
3,198 metro.co.uk .uk 59
3,253 billboard.com .com 78
3,286 flipboard.com .com 64
3,342 lifehacker.com .com 65
3,368 nzherald.co.nz .nz 56
3,371 nymag.com .com 74
3,418 deadline.com .com 81
3,433 thefreedictionary.com .com 71
3,499 amazon.se .se 40
3,520 amazon.ae .ae 40
3,524 chron.com .com 54
3,533 vanityfair.com .com 81
3,576 abc.es .es 81
3,595 politico.eu .eu 62
3,598 amazon.nl .nl 40
3,642 yahoo.net .net 67
3,717 ansa.it .it 85
3,740 amnesty.org .org 89
3,808 toyota.com .com 60
3,916 news24.com .com 56
3,952 gitea.com .com 69
3,963 nos.nl .nl 69
3,974 aljazeera.net .net 89
4,070 ilsole24ore.com .com 78
4,161 kompas.com .com 77
4,304 tvtropes.org .org 55
4,333 derstandard.at .at 56
4,512 amazon.com.tr .tr 40
4,532 biorxiv.org .org 44
4,551 yna.co.kr .kr 87
4,553 20minutes.fr .fr 71
4,592 lastampa.it .it 81
4,684 msnbc.com .com 75
4,816 polygon.com .com 83
4,817 hurriyet.com.tr .tr 81
4,866 channel4.com .com 56
4,925 cadenaser.com .com 78
4,987 dr.dk .dk 81
5,002 mercadolibre.cl .cl 67
5,057 deccanherald.com .com 64
5,068 gq.com .com 81
5,096 nine.com.au .au 71
5,146 everydayhealth.com .com 60
5,153 theage.com.au .au 75
5,158 mercurynews.com .com 78
5,205 lapresse.ca .ca 65
5,229 eltiempo.com .com 85
5,251 dallasnews.com .com 54
5,274 csmonitor.com .com 76
5,297 chinatimes.com .com 64
5,375 mercadolibre.com.co .co 67
5,413 expressen.se .se 61
5,457 diigo.com .com 35
5,463 rainews.it .it 53
5,523 architecturaldigest.com .com 83
5,547 amazon.ie .ie 40
5,678 dn.se .se 60
5,714 francetvinfo.fr .fr 53
5,722 hola.com .com 90
5,726 chefkoch.de .de 81
5,752 sankei.com .com 76
5,775 tv2.no .no 70
5,834 motherjones.com .com 69
5,846 runescape.wiki .wiki 81
5,874 hs.fi .fi 68
5,904 windstream.net .net 53
5,912 pagesix.com .com 80
5,948 suntimes.com .com 81
5,960 milliyet.com.tr .tr 69
5,993 eonline.com .com 81
6,020 giga.de .de 81
6,042 sporcle.com .com 87
6,062 nhk.jp .jp 64
6,089 azcentral.com .com 74
6,125 denverpost.com .com 78
6,159 instiz.net .net 58
6,228 sbnation.com .com 69
6,245 raiplay.it .it 55
6,246 eurogamer.net .net 57
6,288 vulture.com .com 72
6,308 wwd.com .com 78
6,352 tv2.dk .dk 74
6,356 freep.com .com 73
6,361 ici.fr .fr 87
6,386 huffingtonpost.co.uk .uk 82
6,391 sex-studentki.live .live 56
6,429 emol.com .com 70
6,464 ilpost.it .it 75
6,473 sfchronicle.com .com 54
6,512 telegram.com .com 73
Page 1 of 6Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the PerplexityBot reference, the full census, and the JSON endpoint.