Blocklist · Google

Sites that block Google-Extended

2,269 of the 29,991 domains we have measured, 8%, disallow google-extended at the site root in robots.txt. Google-Extended collects content that may be used to train a model.

Every domain here has withheld its content from Google's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,269 of 29,991 measured domains (8%) disallow google-extended at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Google-Extended", measured 2026-11-22. https://crawlcensus.com/blocked/google-extended

The list 2,269 domains

RankDomainTLDAI access score
40,713 dwds.de .de 64
40,740 sheetjs.com .com 59
40,741 theblast.com .com 92
40,775 wcax.com .com 77
40,784 thedenverchannel.com .com 85
40,796 elpasotimes.com .com 73
40,805 straight.com .com 79
40,817 cancilleria.gov.co .co 60
40,859 practicalmachinist.com .com 67
40,863 bienpublic.com .com 83
40,868 sayweee.com .com 72
40,876 cntraveller.in .in 81
40,904 nesn.com .com 73
40,912 saambaa.com .com 66
40,961 wplace.live .live 73
40,971 amlegal.com .com 76
40,973 amainhobbies.com .com 47
41,019 tmj4.com .com 83
41,083 summitpost.org .org 56
41,088 ispe.org .org 67
41,098 gqmagazine.fr .fr 82
41,203 analdin.xxx .xxx 44
41,227 musescore.org .org 55
41,235 tampabay28.com .com 85
41,295 newson6.com .com 82
41,308 sunbeltrentals.com .com 79
41,317 waymarking.com .com 48
41,336 archinect.com .com 68
41,349 planet-wissen.de .de 71
41,357 mamul.am .am 66
41,394 capitalizemytitle.com .com 71
41,420 prq.to .to 42
41,459 saharareporters.com .com 53
41,465 naughtyamerica.com .com 54
41,474 abc3340.com .com 73
41,542 oefb.at .at 50
41,577 weblly.com .com 86
41,590 at5.nl .nl 70
41,603 lci.fr .fr 84
41,614 thebulwark.com .com 54
41,647 cjonline.com .com 73
41,652 flowmusic.app .app 64
41,653 donaukurier.de .de 78
41,713 roanoke.com .com 80
41,721 canarias7.es .es 83
41,760 dailybreeze.com .com 76
41,824 smiletemplates.com .com 47
41,826 defcon.org .org 66
41,851 pixelfed.social .social 46
41,865 thehealthy.com .com 87
41,872 vanityfair.fr .fr 66
41,900 inspirehep.net .net 52
41,934 crikey.com.au .au 88
41,947 vogue.co.jp .jp 65
41,958 theledger.com .com 74
41,962 okinawatimes.co.jp .jp 79
41,980 aqi.in .in 75
41,987 intermountainhealthcare.org .org 63
42,010 aprs.fi .fi 41
42,086 nintendoeverything.com .com 89
42,099 ephotozine.com .com 64
42,105 odi.org .org 54
42,112 news9.com .com 85
42,160 tcpalm.com .com 73
42,192 weserv.nl .nl 55
42,222 boomi.in .in 77
42,248 architecture.com .com 59
42,262 advrider.com .com 41
42,289 warosu.org .org 47
42,290 news5cleveland.com .com 85
42,293 tfd.com .com 69
42,336 eweka.nl .nl 75
42,353 priuschat.com .com 55
42,423 welib.org .org 49
42,463 grillio.com .com 53
42,478 cbs6albany.com .com 72
42,505 medietall.no .no 48
42,512 tech-ties.net .net 85
42,592 erowid.org .org 40
42,595 101soundboards.com .com 78
42,607 wruser.org .org 43
42,611 podimo.com .com 70
42,614 citizen-times.com .com 74
42,666 nhregister.com .com 54
42,670 wy903.com .com 53
42,698 sol.no .no 74
42,728 wishtv.com .com 80
42,733 wfsb.com .com 78
42,800 1000kitap.com .com 42
42,835 iodonna.it .it 86
42,842 bahamaslocal.com .com 61
42,849 hoganlovells.com .com 81
42,862 horseracingnation.com .com 72
42,874 kone.gg .gg 58
42,906 bilh.org .org 92
42,919 tcrf.net .net 29
42,934 v2006.com .com 49
42,960 ceskenoviny.cz .cz 68
42,978 prospectmagazine.co.uk .uk 70
42,981 viewbug.com .com 83
43,089 port.hu .hu 68
43,117 polycasino.com .com 76
43,122 urbia.de .de 86
43,126 xfolio.jp .jp 72
43,132 jtbc.co.kr .kr 70
43,207 tv4play.se .se 77
43,216 onetz.de .de 89
43,218 sermoncentral.com .com 59
43,251 sufficientvelocity.com .com 73
43,260 exchange-rates.org .org 81
43,263 blr.com .com 94
43,268 candlepowerforums.com .com 61
43,281 xvix.eu .eu 75
43,302 seacoastonline.com .com 69
43,309 tonkeeper.com .com 57
43,315 stateline.org .org 69
43,325 news3lv.com .com 73
43,329 skinnytaste.com .com 90
43,414 cameradb.review .review 62
43,415 pokeheroes.com .com 57
43,455 noi.md .md 54
43,480 remoteok.com .com 76
43,544 nautiljon.com .com 62
43,587 admagazine.fr .fr 81
43,605 zonerama.com .com 30
43,618 3gpp.org .org 53
43,666 tasty.co .co 79
43,667 sweclockers.com .com 63
43,677 lightpdf.com .com 86
43,742 apsnet.org .org 50
43,802 fussballdaten.de .de 76
43,883 kctv5.com .com 78
43,890 21jingji.com .com 65
43,986 nn.de .de 83
44,007 vanguardia.com .com 83
44,026 gainesville.com .com 66
44,043 matters.town .town 56
44,055 270towin.com .com 72
44,057 currencyaz.com .com 55
44,099 wistv.com .com 76
44,136 bookbeat.com .com 68
44,151 betterbanned.com .com 71
44,155 lbbonline.com .com 70
44,169 fox5vegas.com .com 76
44,183 barcablaugranes.com .com 68
44,228 notionpress.com .com 64
44,230 mcpvp.club .club 50
44,252 braunschweiger-zeitung.de .de 65
44,255 cagesideseats.com .com 72
44,313 um.ac.id .id 83
44,349 nhnieuws.nl .nl 74
44,366 capitalfm.com .com 80
44,404 umm.edu .edu 77
44,418 adoptimix.com .com 68
44,440 hitmaal.io .io 71
44,450 infoseek.com .com 76
44,489 iha.com.tr .tr 52
44,512 pinknews.co.uk .uk 90
44,556 tritan.gg .gg 61
44,575 flgov.com .com 54
44,635 wowinterface.com .com 58
44,689 notthebee.com .com 79
44,723 dailygazette.com .com 80
44,746 melbet.com .com 49
44,780 virgool.io .io 58
44,807 gofeminin.de .de 74
44,829 mobilism.org .org 48
44,874 news-leader.com .com 62
44,878 rtvnoord.nl .nl 73
44,880 santaads.com .com 73
44,904 popup-blocker.org .org 56
44,908 mora.jp .jp 45
44,912 audima.co .co 80
44,928 wgt.com .com 80
44,962 abc6onyourside.com .com 71
44,968 savannahnow.com .com 64
45,003 preciso.net .net 57
45,063 wkyt.com .com 78
45,120 cmha.ca .ca 76
45,150 samplefocus.com .com 60
45,157 durev-inc.xyz .xyz 59
45,159 lansingstatejournal.com .com 62
45,165 parkpage.in .in 41
45,180 pivotalweather.com .com 25
45,184 kshb.com .com 85
45,195 natgeotv.com .com 81
45,216 tbcpl.lol .lol 59
45,240 vogue.mx .mx 65
45,243 abcnews4.com .com 67
45,271 deckshop.pro .pro 63
45,272 rtvutrecht.nl .nl 73
45,316 eumetsat.int .int 80
45,349 wp.de .de 65
45,372 devid.info .info 57
45,375 cleveland19.com .com 78
45,390 tupalo.com .com 57
45,440 nrz.de .de 80
45,461 lgbtqnation.com .com 72
45,482 iyottube.ph .ph 68
45,509 hysky.de .de 38
PreviousPage 10 of 12Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Google-Extended reference, the full census, and the JSON endpoint.