Blocklist · Perplexity

Sites that block PerplexityBot

1,048 of the 29,120 domains we have measured, 4%, disallow perplexitybot at the site root in robots.txt. PerplexityBot builds the index that decides whether the operator's assistant cites a page.

Every domain here has removed itself from Perplexity's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

1,048 of 29,120 measured domains (4%) disallow perplexitybot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-08-24 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block PerplexityBot", measured 2026-08-24. https://crawlcensus.com/blocked/perplexitybot

The list 1,048 domains

RankDomainTLDAI access score
26 amazon.com .com 40
54 tiktok.com .com 41
58 yahoo.com .com 69
62 msn.com .com 34
121 amazonvideo.com .com 63
157 nytimes.com .com 65
190 cnn.com .com 50
193 theguardian.com .com 60
204 forbes.com .com 72
207 bbc.com .com 69
217 t-online.de .de 77
226 bbc.co.uk .uk 70
260 launchpad.net .net 46
281 nature.com .com 58
282 weather.com .com 79
318 amazon.co.uk .uk 33
377 amazon.de .de 33
457 cnbc.com .com 61
494 amazon.co.jp .jp 33
499 aol.com .com 60
533 wired.com .com 74
543 patreon.com .com 60
552 usatoday.com .com 75
571 uol.com.br .br 74
609 amazon.fr .fr 33
623 amazon.co.za .za 33
627 dailymail.co.uk .uk 62
635 amazon.ca .ca 33
659 amazon.in .in 33
662 cnet.com .com 75
681 dailymail.com .com 62
682 primevideo.com .com 50
706 amazon.it .it 33
725 amazon.es .es 33
740 mercadolivre.com.br .br 72
763 bild.de .de 74
787 apnews.com .com 84
800 welt.de .de 65
812 amazon.com.au .au 33
815 theverge.com .com 68
823 nbcnews.com .com 63
833 amazon.com.br .br 33
931 mercadolibre.com.ar .ar 72
942 repubblica.it .it 77
980 theatlantic.com .com 79
1,017 pbs.org .org 80
1,019 theconversation.com .com 52
1,024 garmin.com .com 65
1,027 huffpost.com .com 82
1,032 amazon.com.mx .mx 34
1,056 marca.com .com 85
1,073 bfmtv.com .com 71
1,083 nypost.com .com 73
1,098 franceinfo.fr .fr 66
1,104 idnes.cz .cz 73
1,105 cookpad.com .com 66
1,114 gsmarena.com .com 65
1,125 mercadolibre.com.mx .mx 72
1,165 mercadolibre.com .com 50
1,177 pimpbunny.com .com 61
1,189 aftonbladet.se .se 71
1,208 vg.no .no 73
1,209 dcinside.com .com 71
1,223 furaffinity.net .net 41
1,231 gazzetta.it .it 80
1,258 abc.net.au .au 80
1,273 ladepeche.fr .fr 80
1,275 huffingtonpost.com .com 82
1,286 actu.fr .fr 76
1,300 f95zone.to .to 49
1,305 dw.com .com 36
1,348 sport.es .es 80
1,355 iqiyi.com .com 57
1,376 dagbladet.no .no 76
1,378 aljazeera.com .com 83
1,409 iltalehti.fi .fi 50
1,442 buzzfeed.com .com 58
1,446 ekstrabladet.dk .dk 60
1,456 eenadu.net .net 73
1,467 hdtube.porn .porn 68
1,723 lectormangass.net .net 76
1,765 newsweek.com .com 68
1,793 newyorker.com .com 71
1,831 zdnet.com .com 61
1,835 wikihow.com .com 72
1,847 arstechnica.com .com 72
1,856 scientificamerican.com .com 82
1,984 themoviedb.org .org 61
1,993 ign.com .com 64
2,006 amazon.eg .eg 34
2,010 mashable.com .com 62
2,062 nba.com .com 78
2,115 mirror.co.uk .uk 47
2,118 variety.com .com 80
2,189 vox.com .com 68
2,230 meb.gov.tr .tr 60
2,258 mparticle.com .com 57
2,299 guardian.co.uk .uk 60
2,325 nrk.no .no 61
2,352 rollingstone.com .com 83
2,370 umd.edu .edu 85
2,423 pcmag.com .com 65
2,430 sfgate.com .com 49
2,433 express.co.uk .uk 44
2,508 yr.no .no 61
2,530 smh.com.au .au 69
2,561 technologyreview.com .com 75
2,562 zeit.de .de 71
2,581 hollywoodreporter.com .com 79
2,656 tmdb.org .org 66
2,659 theglobeandmail.com .com 56
2,691 newscientist.com .com 57
2,723 yumpu.com .com 78
2,786 chicagotribune.com .com 75
2,822 indianexpress.com .com 83
2,880 sueddeutsche.de .de 68
2,899 vanityfair.it .it 69
2,917 faz.net .net 76
2,951 asahi.com .com 72
2,969 today.com .com 59
2,971 prokerala.com .com 78
2,974 thehindu.com .com 50
2,975 imageshack.us .us 29
2,989 vogue.com .com 78
3,109 ctvnews.ca .ca 78
3,116 newsbreak.com .com 84
3,154 mapquest.com .com 72
3,198 metro.co.uk .uk 56
3,253 billboard.com .com 78
3,286 flipboard.com .com 60
3,335 infojobs.net .net 51
3,342 lifehacker.com .com 63
3,368 nzherald.co.nz .nz 47
3,371 nymag.com .com 71
3,418 deadline.com .com 81
3,433 thefreedictionary.com .com 66
3,499 amazon.se .se 37
3,520 amazon.ae .ae 38
3,524 chron.com .com 54
3,533 vanityfair.com .com 77
3,542 orf.at .at 67
3,576 abc.es .es 81
3,588 stuff.co.nz .nz 50
3,595 politico.eu .eu 62
3,598 amazon.nl .nl 37
3,621 nydailynews.com .com 71
3,642 yahoo.net .net 77
3,717 ansa.it .it 80
3,808 toyota.com .com 57
3,869 pcworld.com .com 77
3,882 radiofrance.fr .fr 80
3,909 aol.de .de 60
3,916 news24.com .com 56
3,963 nos.nl .nl 61
3,974 aljazeera.net .net 84
4,065 seekingalpha.com .com 79
4,070 ilsole24ore.com .com 73
4,097 amazon.pl .pl 37
4,107 thestar.com .com 60
4,161 kompas.com .com 80
4,199 mainichi.jp .jp 58
4,240 amazon.sa .sa 38
4,304 tvtropes.org .org 41
4,330 snopes.com .com 85
4,333 derstandard.at .at 53
4,512 amazon.com.tr .tr 37
4,551 yna.co.kr .kr 83
4,553 20minutes.fr .fr 67
4,592 lastampa.it .it 77
4,684 msnbc.com .com 73
4,816 polygon.com .com 81
4,817 hurriyet.com.tr .tr 78
4,866 channel4.com .com 52
4,925 cadenaser.com .com 78
4,987 dr.dk .dk 76
5,002 mercadolibre.cl .cl 68
5,037 imageshack.com .com 29
5,057 deccanherald.com .com 60
5,068 gq.com .com 77
5,096 nine.com.au .au 71
5,146 everydayhealth.com .com 57
5,153 theage.com.au .au 63
5,158 mercurynews.com .com 75
5,205 lapresse.ca .ca 62
5,229 eltiempo.com .com 79
5,230 ms.now .now 73
5,251 dallasnews.com .com 50
5,274 csmonitor.com .com 74
5,297 chinatimes.com .com 79
5,375 mercadolibre.com.co .co 64
5,413 expressen.se .se 58
5,416 gentoo.org .org 57
5,463 rainews.it .it 67
5,523 architecturaldigest.com .com 78
5,547 amazon.ie .ie 40
5,652 band.us .us 55
5,671 codeforces.com .com 45
5,678 dn.se .se 63
5,714 francetvinfo.fr .fr 62
5,722 hola.com .com 89
Page 1 of 6Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the PerplexityBot reference, the full census, and the JSON endpoint.