Blocklist · Apple

Sites that block Applebot

317 of the 26,641 domains we have measured, 1%, disallow applebot at the site root in robots.txt. Applebot builds the index that decides whether the operator's assistant cites a page.

Every domain here has removed itself from Apple's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

317 of 26,641 measured domains (1%) disallow applebot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-08-23 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Applebot", measured 2026-08-23. https://crawlcensus.com/blocked/applebot

The list 317 domains

RankDomainTLDAI access score
29,142 floridatoday.com .com 74
29,181 scarymommy.com .com 86
29,499 conjur.com.br .br 66
29,553 hankookilbo.com .com 80
29,701 thieme-connect.de .de 41
29,787 blogmura.com .com 77
29,821 providencejournal.com .com 73
29,946 lareviewofbooks.org .org 52
29,980 lidovky.cz .cz 67
30,074 yugipedia.com .com 62
30,237 clarionledger.com .com 74
30,387 bsc.es .es 56
30,393 ecode360.com .com 48
30,443 dobrzemieszkaj.pl .pl 61
30,703 wickedlocal.com .com 75
30,810 kentonline.co.uk .uk 76
30,986 commercialappeal.com .com 74
30,992 huffingtonpost.it .it 82
31,032 howlongtobeat.com .com 50
31,176 edp24.co.uk .uk 71
31,282 vndb.org .org 60
31,489 theodysseyonline.com .com 82
31,549 lohud.com .com 74
31,554 currencyconverter.io .io 41
31,857 weawow.com .com 57
32,104 worldsurfleague.com .com 61
32,263 shacknews.com .com 73
32,267 theargus.co.uk .uk 71
32,326 ratgeberrecht.eu .eu 88
32,388 rgj.com .com 73
32,437 hoopshype.com .com 70
32,671 classicfm.com .com 83
32,803 oxfordmail.co.uk .uk 71
32,806 tvnet.lv .lv 79
32,814 write.as .as 69
32,896 thenorthernecho.co.uk .uk 71
33,332 desertsun.com .com 74
33,493 timesfreepress.com .com 56
33,757 dealabs.com .com 78
34,445 monoskop.org .org 43
34,718 sportsyou.com .com 86
34,745 auto-tests.com .com 56
34,822 milanofinanza.it .it 82
34,870 mel.org .org 42
34,961 volksfreund.de .de 67
34,973 naplesnews.com .com 73
35,033 online-literature.com .com 50
35,062 dailypress.com .com 77
35,543 news-journalonline.com .com 73
35,669 houstonpublicmedia.org .org 45
35,760 montgomerycountymd.gov .gov 69
35,800 wn.de .de 80
36,292 dailycamera.com .com 77
36,334 ytmnd.com .com 42
36,434 businessday.co.za .za 82
36,501 ctext.org .org 71
36,575 dailyecho.co.uk .uk 72
36,667 grindosaur.com .com 55
36,976 aviation-safety.net .net 48
37,305 hotcars.com .com 82
37,988 car.info .info 86
38,015 thetravel.com .com 81
38,060 podolsknet.ru .ru 96
38,148 news-press.com .com 73
38,199 offidocs.com .com 87
38,257 4players.de .de 83
38,327 inforum.com .com 70
38,409 igt.com .com 49
38,482 royalacademy.org.uk .uk 52
38,507 bournemouthecho.co.uk .uk 71
38,712 simplebooking.it .it 74
38,973 designcrowd.com .com 76
39,206 futurezone.de .de 85
39,393 zakzak.co.jp .jp 72
39,516 muz.uz .uz 70
39,824 werstreamt.es .es 52
40,068 intelligentgolf.co.uk .uk 66
40,317 iza.ne.jp .jp 79
40,413 dualshockers.com .com 83
40,512 thetelegraphandargus.co.uk .uk 69
40,638 main-echo.de .de 64
40,693 bonn.de .de 77
40,713 dwds.de .de 64
40,793 yorkpress.co.uk .uk 71
40,796 elpasotimes.com .com 73
40,858 inspiredtaste.net .net 70
40,931 productreview.com.au .au 87
41,088 ispe.org .org 67
41,121 lancashiretelegraph.co.uk .uk 69
41,232 chipsmall.com .com 69
41,368 gunbark.dev .dev 36
41,519 greenme.it .it 84
41,647 cjonline.com .com 73
41,696 fatherly.com .com 86
41,736 eadt.co.uk .uk 71
41,760 dailybreeze.com .com 80
41,826 defcon.org .org 66
41,932 santacruzsentinel.com .com 78
41,958 theledger.com .com 74
42,035 recordchina.co.jp .jp 58
42,042 suaramerdeka.com .com 70
42,076 iex.nl .nl 65
42,113 glasgowtimes.co.uk .uk 71
42,160 tcpalm.com .com 73
42,835 iodonna.it .it 86
42,862 horseracingnation.com .com 72
42,925 pixta.jp .jp 78
43,154 cryptome.org .org 63
43,256 moly.hu .hu 49
43,983 teambelgium.net .net 59
44,366 capitalfm.com .com 80
44,714 marinij.com .com 79
44,807 gofeminin.de .de 80
44,878 rtvnoord.nl .nl 73
45,002 babycentre.co.uk .uk 63
45,272 rtvutrecht.nl .nl 73
45,298 osapublishing.org .org 56
45,571 wz.de .de 63
45,578 chugoku-np.co.jp .jp 80
45,615 confidentialphonelookup.com .com 60
PreviousPage 2 of 2

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Applebot reference, the full census, and the JSON endpoint.