Blocklist · Apple

Sites that block Applebot-Extended

2,291 of the 29,991 domains we have measured, 8%, disallow applebot-extended at the site root in robots.txt. Applebot-Extended collects content that may be used to train a model.

Every domain here has withheld its content from Apple's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,291 of 29,991 measured domains (8%) disallow applebot-extended at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Applebot-Extended", measured 2026-11-21. https://crawlcensus.com/blocked/applebot-extended

The list 2,291 domains

RankDomainTLDAI access score
22,503 49s.co.uk .uk 39
22,547 vipyonoslots.com .com 58
22,548 mydesihd.com .com 72
22,555 burgerpixel.net .net 56
22,557 foxaholic.com .com 58
22,569 happymod.tube .tube 76
22,583 videystream.store .store 53
22,623 mcall.com .com 78
22,626 medicaldaily.com .com 72
22,633 mynimeku.com .com 73
22,657 believesport.com .com 56
22,666 trevts.com .com 60
22,671 slotor777.ua .ua 76
22,740 zbzoub.com .com 58
22,771 movies4u.clinic .clinic 82
22,804 udea.edu.co .co 57
22,810 gperya.com .com 41
22,820 voir-anime.to .to 73
22,827 bestguiltypleasure.com .com 57
22,838 desimms.com.co .co 77
22,854 alexisbarcelona.com .com 66
22,867 fb77.one .one 50
22,869 videq-l.ink .ink 68
22,891 lolpol.com .com 60
22,923 2trk.info .info 55
22,938 congobet.net .net 45
22,970 meujogodobicho.com.br .br 69
22,971 turskeserije.tv .tv 55
22,972 multimovies.study .study 64
23,007 ogomovies1.com.pk .pk 82
23,044 adzuna.co.uk .uk 51
23,048 alexismiami.com .com 77
23,055 tiktokio.net .net 76
23,071 yomovies.business .business 70
23,073 ttks.tw .tw 49
23,081 satsitset.living .living 39
23,084 app.com .com 69
23,097 cinefreak.net .net 72
23,112 toto12express.org .org 69
23,123 1668manga.com .com 62
23,128 eauctionsindia.com .com 77
23,130 financemasterpro.com .com 79
23,133 javmyanmar.com .com 53
23,137 loteriasdehonduras.com .com 59
23,141 poizdato.net .net 60
23,143 samusar.com .com 46
23,154 rbb24.de .de 80
23,157 mlnba.fun .fun 54
23,167 dubmv.xyz .xyz 35
23,177 pyppo.com .com 55
23,185 hoathinh3d.st .st 78
23,237 bet261.mg .mg 45
23,244 pinayot.com .com 73
23,246 mobilejsr.com .com 54
23,264 olxsob.com .com 83
23,270 depedclub.com .com 80
23,274 pilipinay.tv .tv 82
23,282 goctruyentranhvui30.com .com 64
23,288 catbox.moe .moe 59
23,298 fuegodevida.com .com 58
23,318 yoti.com .com 83
23,324 lunatogel78.com .com 75
23,328 pos4dtototogel84.com .com 70
23,343 tioeroge.com .com 76
23,360 pinaybold.tv .tv 76
23,365 hometogel72.com .com 72
23,368 ssrmovies.luxe .luxe 59
23,379 chotot.com .com 83
23,389 wftoon221.com .com 44
23,392 hotdesifuck.pro .pro 61
23,401 olxexp.com .com 77
23,402 vldeys.space .space 35
23,430 katu.com .com 73
23,442 playgamester.com .com 54
23,447 amnt-16d09m20y.com .com 35
23,452 cbunu.com .com 45
23,472 studyinsaudi.sa .sa 63
23,488 alexisboro.com .com 71
23,496 jps.go.cr .cr 33
23,519 vinahentai.club .club 84
23,545 alexissaddler.com .com 75
23,575 olxsos.com .com 83
23,582 alexismold.com .com 74
23,583 coloksgpaja.com .com 73
23,600 kawanpaitomember.com .com 58
23,613 nordbayern.de .de 81
23,630 olxtst.com .com 63
23,668 alexisverdugo.com .com 75
23,673 dingdongtogel91.com .com 74
23,689 3cr.game .game 60
23,699 alexisnemesis.com .com 71
23,700 alexisuro.com .com 71
23,701 badak178wind.live .live 47
23,703 olxpln.com .com 68
23,707 viideys.sbs .sbs 43
23,708 vildeey.space .space 43
23,715 1punrewudx.com .com 45
23,752 in.game .game 37
23,754 inviv.top .top 36
23,759 kingsofsatta.com .com 59
23,762 ldidyg.com .com 44
23,773 naychje.com .com 44
23,782 playindialottery.com .com 44
23,788 satta-king-live.com .com 76
23,790 sattamatka.email .email 84
23,795 shillongteergrounds.in .in 81
23,798 spinjeet365.com .com 36
23,846 dailypost.ng .ng 83
23,875 imore.com .com 81
23,964 pcwelt.de .de 78
24,000 icecat.biz .biz 44
24,014 askmen.com .com 47
24,022 twinkl.co.uk .uk 37
24,028 canberratimes.com.au .au 79
24,102 knoxnews.com .com 74
24,141 cntraveller.com .com 81
24,154 novaskin.me .me 51
24,157 whathifi.com .com 87
24,190 jacksonville.com .com 74
24,233 glamourmagazine.co.uk .uk 81
24,307 ewtn.com .com 70
24,354 youtubers.me .me 70
24,413 irishmirror.ie .ie 47
24,453 dragcave.net .net 61
24,505 megasmp.gg .gg 84
24,525 zin.ru .ru 41
24,567 newspicks.com .com 44
24,569 local10.com .com 69
24,593 vogue.in .in 64
24,603 globalknowledge.com .com 61
24,612 blogbright.net .net 53
24,657 blockshopper.com .com 57
24,661 librivox.org .org 55
24,714 occrp.org .org 62
24,733 humanite.fr .fr 87
24,744 advisor.travel .travel 46
24,747 jazz.com.pk .pk 46
24,783 pcgameshardware.de .de 72
24,787 waikato.ac.nz .nz 89
24,802 bristolpost.co.uk .uk 47
24,842 sdstate.edu .edu 74
24,853 nameswriter.com .com 48
24,878 happycolorapp.com .com 77
24,882 uol.com .com 82
24,892 eldiariomontanes.es .es 82
24,934 svtplay.se .se 78
24,946 vogue.fr .fr 81
24,961 miaminewtimes.com .com 73
24,977 wired.it .it 83
25,007 digitalcameraworld.com .com 86
25,031 franceculture.fr .fr 81
25,048 tokyo-np.co.jp .jp 81
25,065 ny1.com .com 68
25,108 wheree.com .com 86
25,115 pilotonline.com .com 79
25,131 ausfreeslots.com .com 77
25,133 myrecipes.com .com 77
25,184 kompasiana.com .com 85
25,221 cpubenchmark.net .net 70
25,239 greatist.com .com 80
25,299 pageloft.de .de 80
25,382 lbc.co.uk .uk 86
25,392 bsportsfan.com .com 76
25,451 omaha.com .com 80
25,476 podcastaddict.com .com 77
25,478 franceinter.fr .fr 80
25,564 theadvocate.com .com 71
25,566 irishnews.com .com 68
25,576 giraffic.com .com 75
25,587 sfexaminer.com .com 69
25,602 behindthename.com .com 52
25,606 meteotrend.com .com 49
25,625 americanthinker.com .com 56
25,632 commonwealthfund.org .org 63
25,662 experiment.com .com 60
25,748 booru.org .org 54
25,756 ctinsider.com .com 54
25,776 zinio.com .com 76
25,796 shopltk.com .com 83
25,797 wuytl.com .com 51
25,839 delawareonline.com .com 74
25,903 heraldtribune.com .com 73
25,911 arkansasonline.com .com 71
25,939 moneydj.com .com 64
25,993 vivodemisrentas.net .net 57
26,005 people.inc .inc 64
26,108 kebirhost.com .com 79
26,114 democratandchronicle.com .com 73
26,155 attendanceondemand.com .com 60
26,174 discoverhongkong.com .com 36
26,178 atgtickets.com .com 69
26,210 kstp.com .com 83
26,235 rosettastone.com .com 74
26,240 yogajournal.com .com 77
26,249 guitarworld.com .com 84
26,261 indiaforums.com .com 59
26,284 daytondailynews.com .com 67
26,322 gimkit.com .com 42
26,342 straightdope.com .com 76
26,379 brisbanetimes.com.au .au 75
PreviousPage 6 of 12Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Applebot-Extended reference, the full census, and the JSON endpoint.