Blocklist · Apple

Sites that block Applebot

350 of the 29,991 domains we have measured, 1%, disallow applebot at the site root in robots.txt. Applebot builds the index that decides whether the operator's assistant cites a page.

Every domain here has removed itself from Apple's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

350 of 29,991 measured domains (1%) disallow applebot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Applebot", measured 2026-11-22. https://crawlcensus.com/blocked/applebot

The list 350 domains

RankDomainTLDAI access score
62 msn.com .com 41
571 uol.com.br .br 82
662 cnet.com .com 79
942 repubblica.it .it 85
955 corriere.it .it 63
1,019 theconversation.com .com 62
1,098 franceinfo.fr .fr 60
1,104 idnes.cz .cz 80
1,223 furaffinity.net .net 39
1,305 dw.com .com 42
1,456 eenadu.net .net 67
1,831 zdnet.com .com 76
1,993 ign.com .com 62
2,010 mashable.com .com 61
2,215 techradar.com .com 87
2,230 meb.gov.tr .tr 66
2,423 pcmag.com .com 63
2,585 livescience.com .com 85
2,786 chicagotribune.com .com 79
3,331 tomshardware.com .com 87
3,342 lifehacker.com .com 65
3,595 politico.eu .eu 62
3,873 space.com .com 85
4,070 ilsole24ore.com .com 78
4,161 kompas.com .com 77
4,304 tvtropes.org .org 55
4,532 biorxiv.org .org 44
4,592 lastampa.it .it 81
4,987 dr.dk .dk 81
5,026 pcgamer.com .com 85
5,146 everydayhealth.com .com 60
5,158 mercurynews.com .com 78
5,205 lapresse.ca .ca 65
5,297 chinatimes.com .com 64
5,457 diigo.com .com 35
5,711 nimo.tv .tv 66
5,714 francetvinfo.fr .fr 53
5,775 tv2.no .no 70
5,846 runescape.wiki .wiki 81
5,909 bustle.com .com 86
6,088 futura-sciences.com .com 93
6,089 azcentral.com .com 74
6,125 denverpost.com .com 78
6,246 eurogamer.net .net 57
6,352 tv2.dk .dk 74
6,356 freep.com .com 73
6,377 gamesradar.com .com 85
6,429 emol.com .com 70
6,512 telegram.com .com 73
6,513 sandiegouniontribune.com .com 78
6,816 maxroll.gg .gg 59
6,948 nicematin.com .com 77
7,109 military.com .com 84
7,119 rp-online.de .de 79
7,275 baltimoresun.com .com 76
7,363 bhaskar.com .com 75
8,094 nefisyemektarifleri.com .com 76
8,173 leggo.it .it 62
8,380 veikkaus.fi .fi 67
8,830 portalsamorzadowy.pl .pl 69
8,866 theweek.com .com 84
8,883 manhuagui.com .com 61
8,897 rynekzdrowia.pl .pl 64
9,238 xxxmovies.life .life 64
9,339 detroitnews.com .com 68
9,388 law.com .com 68
9,542 findnovel.net .net 64
10,335 windowscentral.com .com 85
10,389 archive-it.org .org 62
10,470 babycenter.com .com 62
10,501 ocregister.com .com 80
10,885 livestrong.com .com 80
10,934 huffingtonpost.fr .fr 81
11,015 inverse.com .com 88
11,147 intechopen.com .com 67
11,349 posteo.de .de 67
11,457 wnp.pl .pl 65
11,572 overheid.nl .nl 68
11,835 scispace.com .com 42
12,111 techpowerup.com .com 50
12,113 bostonherald.com .com 78
12,250 globalso.com .com 64
12,377 delfi.ee .ee 57
12,441 novelfire.net .net 64
12,533 indystar.com .com 73
12,550 kiplinger.com .com 85
12,743 extremetech.com .com 64
12,770 imginn.com .com 77
13,243 snu.ac.kr .kr 70
13,320 timesnownews.com .com 66
13,355 marieclaire.com .com 85
13,667 dispatch.com .com 74
13,699 freesound.org .org 71
13,783 creativebloq.com .com 87
13,825 heraldscotland.com .com 81
13,871 ilex.by .by 59
13,879 tennessean.com .com 74
13,987 mydealz.de .de 79
14,053 androidcentral.com .com 83
14,374 delfi.lv .lv 80
14,449 sil.org .org 64
14,826 rockpapershotgun.com .com 58
15,174 pcgamesn.com .com 83
15,218 statesman.com .com 51
15,233 thieme-connect.com .com 39
15,269 gamesindustry.biz .biz 57
15,401 desmoinesregister.com .com 74
15,557 cincinnati.com .com 74
16,103 dweb.link .link 65
16,118 healio.com .com 69
16,134 homesandgardens.com .com 84
16,209 ipfs.io .io 65
16,223 smashwords.com .com 58
16,317 ilmattino.it .it 62
16,520 hotukdeals.com .com 78
16,564 mapgenie.io .io 59
16,664 lightningmaps.org .org 51
16,814 whattoexpect.com .com 65
17,042 northjersey.com .com 74
17,455 twincities.com .com 81
17,469 palmbeachpost.com .com 73
17,492 ina.fr .fr 76
17,522 daangn.com .com 71
17,886 agrarheute.com .com 75
17,892 eiu.com .com 81
17,936 cinemablend.com .com 87
18,214 xxxbunker.com .com 81
18,271 ranking-deli.jp .jp 88
18,280 hoerzu.de .de 45
18,309 mans.io .io 60
18,324 mic.com .com 87
18,402 xueqiu.com .com 47
18,595 trycloudflare.com .com 52
18,606 elitedaily.com .com 86
18,782 pepper.pl .pl 76
18,863 dailynews.com .com 76
18,883 courier-journal.com .com 74
18,894 courrierinternational.com .com 83
18,978 dexerto.com .com 78
19,312 pinayflix.uk .uk 46
19,891 musicradar.com .com 87
20,007 juraforum.de .de 52
20,364 derwesten.de .de 83
20,718 itpro.com .com 83
20,845 wnd.com .com 90
20,847 gardeningknowhow.com .com 83
20,958 pressdemocrat.com .com 80
21,139 ledevoir.com .com 70
21,415 bangordailynews.com .com 71
21,566 whowhatwear.com .com 82
21,568 cvbankas.lt .lt 74
21,686 zte.com.cn .cn 61
21,707 khronos.org .org 68
21,809 cyclingnews.com .com 85
21,823 desy.de .de 62
21,828 wallpaper.com .com 85
22,007 vg247.com .com 58
22,365 petitesannonces.ch .ch 67
22,623 mcall.com .com 78
23,084 app.com .com 69
23,157 mlnba.fun .fun 54
23,875 imore.com .com 81
24,014 askmen.com .com 47
24,102 knoxnews.com .com 74
24,157 whathifi.com .com 87
24,190 jacksonville.com .com 74
24,525 zin.ru .ru 41
24,842 sdstate.edu .edu 74
24,882 uol.com .com 82
25,007 digitalcameraworld.com .com 86
25,115 pilotonline.com .com 79
25,382 lbc.co.uk .uk 86
25,476 podcastaddict.com .com 77
25,566 irishnews.com .com 68
25,839 delawareonline.com .com 74
25,903 heraldtribune.com .com 73
25,911 arkansasonline.com .com 71
26,114 democratandchronicle.com .com 73
26,249 guitarworld.com .com 84
26,342 straightdope.com .com 76
26,853 tallahassee.com .com 74
27,149 eda.yandex .yandex 56
27,315 fourfourtwo.com .com 84
27,361 westfalen-blatt.de .de 81
27,380 wmagazine.com .com 86
27,482 tug.org .org 44
27,723 geek.com .com 38
27,737 texasattorneygeneral.gov .gov 65
27,833 apotheken-umschau.de .de 45
28,083 varsitytutors.com .com 84
28,320 laptopmag.com .com 87
28,626 openfoodfacts.org .org 59
28,678 thenational.scot .scot 81
28,792 uesp.net .net 55
28,794 eastbaytimes.com .com 79
29,139 u-cursos.cl .cl 51
29,181 scarymommy.com .com 83
29,390 kompas.id .id 64
29,499 conjur.com.br .br 73
29,553 hankookilbo.com .com 84
Page 1 of 2Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Applebot reference, the full census, and the JSON endpoint.