Blocklist · Google

Sites that block Google-Extended

2,269 of the 29,991 domains we have measured, 8%, disallow google-extended at the site root in robots.txt. Google-Extended collects content that may be used to train a model.

Every domain here has withheld its content from Google's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,269 of 29,991 measured domains (8%) disallow google-extended at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Google-Extended", measured 2026-11-22. https://crawlcensus.com/blocked/google-extended

The list 2,269 domains

RankDomainTLDAI access score
36,013 mdg188sky.site .site 74
36,017 moviezmad.live .live 71
36,022 partaitogel76.com .com 73
36,038 rogmovies.work .work 61
36,050 ssrmovies.ch .ch 59
36,053 teensexmix.cyou .cyou 71
36,055 thereissearch.com .com 60
36,059 toto12ace.com .com 74
36,060 toto12sphynx.org .org 79
36,068 vinahentai.bond .bond 84
36,069 vinahentai.cloud .cloud 84
36,075 xmazaa.io .io 66
36,080 ydparty01.tv .tv 86
36,154 hashthemes.com .com 82
36,172 tfw2005.com .com 73
36,181 nsn-now.com .com 46
36,205 fair.org .org 54
36,225 gomotionapp.com .com 84
36,269 inkl.com .com 50
36,334 ytmnd.com .com 41
36,356 elgaronline.com .com 45
36,359 nasaspaceflight.com .com 66
36,370 shindanmaker.com .com 51
36,434 businessday.co.za .za 82
36,436 liquor.com .com 77
36,449 aek365.org .org 61
36,480 desired.de .de 82
36,539 nd-aktuell.de .de 78
36,568 bookcrossing.com .com 38
36,590 fagerneek.com .com 57
36,630 roadsideamerica.com .com 72
36,658 forzastyle.com .com 77
36,668 uqload.is .is 61
36,702 299betvip.com .com 51
36,737 moneyhouse.ch .ch 72
36,743 fcps.edu .edu 64
36,755 lalsace.fr .fr 82
36,757 wsmv.com .com 76
36,761 scrippsnews.com .com 85
36,768 mamshirt.com .com 57
36,770 vturb.com .com 55
36,778 cwmars.org .org 43
36,800 pedigreedatabase.com .com 63
36,803 tennis.com .com 59
36,805 aman.com .com 68
36,818 wssolver.net .net 62
36,832 scoremer.com .com 36
36,838 globalprimereport.com .com 42
36,872 medical-xprt.com .com 54
36,895 uokik.gov.pl .pl 85
36,926 globalpost.com .com 83
36,937 idowa.de .de 90
36,980 rak8s.com .com 49
37,032 asahq.org .org 62
37,070 073m.com .com 52
37,152 stuttgart.de .de 71
37,154 r777.net .net 51
37,158 viddler.com .com 78
37,175 minimalistbaker.com .com 90
37,261 petsathome.com .com 90
37,305 hotcars.com .com 82
37,317 bloodyelbow.com .com 88
37,321 thesamba.com .com 42
37,342 eternalmangas.org .org 77
37,367 mittelbayerische.de .de 77
37,411 desisex.xxx .xxx 65
37,415 tapinto.net .net 35
37,425 jamestown.org .org 82
37,429 imfdb.org .org 47
37,456 theicct.org .org 72
37,478 sslshopper.com .com 61
37,522 twinkl.com .com 37
37,547 bt.no .no 77
37,566 numberempire.com .com 73
37,570 spa.gov.sa .sa 42
37,598 justapinch.com .com 71
37,613 unescap.org .org 72
37,643 bk333.app .app 51
37,671 aerobasegroup.com .com 68
37,700 rutracker.net .net 43
37,708 seventeen.com .com 74
37,724 mmsvibex.net .net 81
37,762 mywebnook.com .com 60
37,807 xn--72czpfe7gxb9cveycua.com .com 74
37,830 autoscout24.nl .nl 86
37,874 484r.com .com 55
37,894 cookieandkate.com .com 86
38,007 wired.jp .jp 78
38,015 thetravel.com .com 81
38,024 arab89.net .net 60
38,037 luscious.net .net 70
38,068 bully-manga.com .com 81
38,069 kyawgyi.com .com 69
38,114 sportico.com .com 64
38,118 abc30.com .com 81
38,148 news-press.com .com 73
38,176 saskatchewan.ca .ca 68
38,193 ardsounds.de .de 85
38,224 kptv.com .com 78
38,234 vinted.com.au .au 68
38,236 datasheetq.com .com 51
38,247 moviemaker.com .com 90
38,252 genengnews.com .com 75
38,313 wingsmob.com .com 57
38,327 inforum.com .com 70
38,328 borsen.dk .dk 74
38,357 arenapro6.com .com 53
38,388 goldderby.com .com 74
38,406 icecat.us .us 61
38,409 igt.com .com 48
38,420 kinipaham.com .com 37
38,437 ersnet.org .org 81
38,455 philanthropy.com .com 75
38,482 royalacademy.org.uk .uk 52
38,502 kantotplus.com .com 79
38,519 kochbar.de .de 62
38,526 haystack.tv .tv 88
38,581 turboquestz.com .com 56
38,603 avj-th.com .com 79
38,609 teensexmix.site .site 71
38,612 xemvl.xxx .xxx 67
38,633 pufted.com .com 35
38,648 wfmu.org .org 54
38,668 stimme.de .de 72
38,679 newschannel5.com .com 85
38,701 multitran.com .com 62
38,708 lursoft.lv .lv 63
38,711 casinotest2.com .com 75
38,713 navyteams.com .com 77
38,737 warhammer-community.com .com 85
38,739 thueringer-allgemeine.de .de 82
38,752 ixiporn.club .club 68
38,790 passportindex.org .org 50
38,814 mas.to .to 31
38,836 winzaa.club .club 36
38,841 gameplayup.com .com 45
38,875 bluemoon-mcfc.co.uk .uk 50
38,944 msg.group .group 91
38,945 postype.com .com 81
38,971 uwm.com .com 59
39,014 nagawinhoki.com .com 75
39,059 mozillafoundation.org .org 55
39,082 1fun.plus .plus 56
39,088 dearlottery.in .in 90
39,094 ind1.bet .bet 58
39,100 latestallgames.com .com 72
39,114 vildeey.site .site 43
39,115 vivicomi21.info .info 70
39,118 xn--3-5wf2bubl3iwbf1f5e8d.com .com 71
39,121 reference-global.com .com 74
39,210 thecentersquare.com .com 78
39,255 grop.net .net 57
39,281 teltarif.de .de 86
39,303 watoday.com.au .au 75
39,350 thehighline.org .org 77
39,369 santafenewmexican.com .com 76
39,393 zakzak.co.jp .jp 72
39,471 vwvortex.com .com 43
39,516 muz.uz .uz 70
39,531 hankooki.com .com 72
39,536 buscape.com.br .br 80
39,540 ky3.com .com 77
39,570 roletapixbr.com .com 51
39,597 indifferentlanguages.com .com 52
39,657 korben.info .info 77
39,682 vinted.gr .gr 86
39,703 deepsilver.com .com 70
39,706 indiehackers.com .com 54
39,712 vsbattles.com .com 68
39,713 learner.org .org 65
39,824 werstreamt.es .es 59
39,833 rnz.de .de 73
39,976 aifpleasurebeh.org .org 35
40,005 bobdylan.com .com 58
40,006 gemtracks.com .com 66
40,037 foxbaltimore.com .com 67
40,049 hpcwire.com .com 63
40,068 intelligentgolf.co.uk .uk 66
40,102 eurasianet.org .org 56
40,114 cgm.com .com 75
40,163 worldnomads.com .com 81
40,177 findmine.com .com 56
40,219 thegrio.com .com 89
40,235 wlos.com .com 71
40,258 listchallenges.com .com 48
40,278 dmhy.org .org 59
40,317 iza.ne.jp .jp 79
40,322 neatorama.com .com 55
40,328 bntu.by .by 80
40,367 centralcharts.com .com 58
40,411 kmib.co.kr .kr 47
40,413 dualshockers.com .com 83
40,419 fox19.com .com 78
40,487 opendatabot.ua .ua 58
40,495 yahoo.com.tw .tw 59
40,511 prompthero.com .com 81
40,527 nationalgeographic.fr .fr 91
40,537 sarna.net .net 81
40,638 main-echo.de .de 64
40,703 mrst.one .one 52
PreviousPage 9 of 12Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Google-Extended reference, the full census, and the JSON endpoint.