Blocklist · Google

Sites that block Google-Extended

2,269 of the 29,991 domains we have measured, 8%, disallow google-extended at the site root in robots.txt. Google-Extended collects content that may be used to train a model.

Every domain here has withheld its content from Google's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,269 of 29,991 measured domains (8%) disallow google-extended at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Google-Extended", measured 2026-11-22. https://crawlcensus.com/blocked/google-extended

The list 2,269 domains

RankDomainTLDAI access score
31,598 pahindot.me .me 77
31,602 quickplayhub.in .in 56
31,623 videyli.co .co 26
31,628 xvidey.top .top 53
31,686 one-name.net .net 29
31,713 womansday.com .com 74
31,733 meteocast.net .net 51
31,758 are.na .na 72
31,782 mastodon.online .online 49
31,786 thespec.com .com 64
31,796 winespectator.com .com 82
31,799 wefut.com .com 50
31,825 em-consulte.com .com 63
31,908 lamag.com .com 78
31,923 pcgames.de .de 71
31,986 gamemaker.io .io 72
31,996 everestgrp.com .com 88
32,000 sciencesetavenir.fr .fr 71
32,010 fox13now.com .com 85
32,032 prx.org .org 74
32,102 vinted.dk .dk 68
32,125 elmercurio.com .com 43
32,174 teamblind.com .com 94
32,183 tellmyroute.com .com 72
32,280 zaobao.com .com 87
32,345 opencv.org .org 66
32,357 vpro.nl .nl 86
32,373 gloswielkopolski.pl .pl 79
32,388 rgj.com .com 73
32,389 sepe.es .es 73
32,391 prweek.com .com 51
32,437 hoopshype.com .com 70
32,456 currencyrate.today .today 67
32,478 la7.it .it 89
32,484 project1999.com .com 47
32,579 dallasobserver.com .com 77
32,595 saveur.com .com 70
32,605 thecrag.com .com 48
32,631 baynews9.com .com 68
32,652 focustaiwan.tw .tw 90
32,671 classicfm.com .com 83
32,706 marianne.net .net 67
32,713 opovo.com.br .br 85
32,790 tatler.com .com 82
32,806 tvnet.lv .lv 79
32,824 datasheetbank.com .com 49
32,828 largus.fr .fr 86
32,832 newsbank.com .com 92
32,908 commonapp.org .org 69
32,919 brighttalk.com .com 68
32,921 fs.blog .blog 80
32,935 svtperformance.com .com 75
32,943 pb.pl .pl 87
32,951 amoxibest.top .top 79
33,018 hugo-spielautomat.com .com 73
33,072 tympanus.net .net 65
33,084 afi.com .com 49
33,179 srvb1.com .com 35
33,184 sciendo.com .com 74
33,243 vgen.co .co 52
33,254 aan.com .com 74
33,272 dn.no .no 77
33,285 marketresearch.com .com 72
33,319 transportenvironment.org .org 88
33,323 ftdichip.com .com 75
33,325 hokkaido-np.co.jp .jp 78
33,349 qq8893.com .com 68
33,354 pucrs.br .br 72
33,364 merca20.com .com 79
33,430 ilmanifesto.it .it 68
33,453 vinted.lu .lu 86
33,494 theanalyst.com .com 88
33,559 bmwfans.info .info 56
33,562 myporntube.com .com 86
33,568 icecat.it .it 44
33,572 diariodolitoral.com.br .br 70
33,597 onlinesequencer.net .net 45
33,610 10news.com .com 82
33,644 tv4.se .se 76
33,654 liegagego33.com .com 49
33,711 leetify.com .com 50
33,738 ruv.is .is 59
33,757 dealabs.com .com 78
33,793 observer.co.uk .uk 74
33,820 pieandmightymsp.com .com 68
33,845 mqseries.net .net 55
33,856 aciprensa.com .com 71
33,915 b254.com .com 54
33,931 lancasteronline.com .com 79
33,934 carlsen.de .de 71
33,953 annapurnabhandarwb.com .com 86
33,954 avxtha.com .com 74
33,961 ogomovies2.com .com 82
33,966 zonexa.xyz .xyz 73
34,023 followfollow.com .com 73
34,027 thai-novel.com .com 88
34,068 kobe-np.co.jp .jp 66
34,089 metopera.org .org 31
34,092 portafolio.co .co 89
34,097 vogue.es .es 65
34,148 asianfanfics.com .com 58
34,156 clickon.pro .pro 57
34,193 ixora.ru .ru 65
34,236 welib.st .st 47
34,263 mp.pl .pl 76
34,301 stevehoffman.tv .tv 65
34,309 unionleader.com .com 63
34,310 coolrom.com.au .au 62
34,350 juju.com .com 72
34,372 cafemom.com .com 76
34,375 columbian.com .com 78
34,387 breakingnews.ie .ie 71
34,405 myfwc.com .com 65
34,445 monoskop.org .org 43
34,464 scores24.live .live 69
34,491 sfweekly.com .com 74
34,528 multimovies.makeup .makeup 75
34,603 stylist.co.uk .uk 72
34,621 ifad.org .org 69
34,636 upmsp.edu.in .in 54
34,669 allporncomics.co .co 64
34,718 sportsyou.com .com 86
34,737 vibe.com .com 80
34,750 mailplus.co.uk .uk 44
34,816 bokepking.cam .cam 81
34,847 sydsvenskan.se .se 52
34,870 mel.org .org 55
34,882 abcactionnews.com .com 85
34,959 tmd.go.th .th 49
34,961 volksfreund.de .de 83
34,963 ipcamlive.com .com 60
34,971 kcrg.com .com 76
34,973 naplesnews.com .com 73
34,974 topagrar.com .com 85
34,983 wbez.org .org 78
34,986 ruhrnachrichten.de .de 75
34,991 monkeyvillage.pro .pro 35
34,995 hiphopkit.com .com 72
35,033 online-literature.com .com 47
35,058 gaoding.com .com 62
35,062 dailypress.com .com 79
35,120 hurawatch.cx .cx 86
35,122 jiaci.org .org 52
35,158 jyllands-posten.dk .dk 70
35,165 mldkyt.com .com 50
35,170 sextvx.com .com 70
35,181 wptv.com .com 85
35,306 natega-eg.net .net 48
35,322 tk999vip.com .com 51
35,326 swr3.de .de 74
35,370 akniga.org .org 92
35,383 alexishave.com .com 66
35,387 alexistogel.ninja .ninja 72
35,388 arabxn.watch .watch 77
35,389 auntymaza.wiki .wiki 70
35,395 dutasexx.bond .bond 79
35,397 egy.sex .sex 58
35,403 makmur76.digital .digital 75
35,413 socialsecuritywb.com .com 75
35,416 under250art.ca .ca 79
35,468 ewn.co.za .za 68
35,488 seminarycentral.org .org 57
35,504 unityroom.com .com 53
35,519 youglish.com .com 59
35,530 comicland.org .org 49
35,543 news-journalonline.com .com 73
35,557 mediaindonesia.com .com 80
35,565 lectormangass.com .com 77
35,579 secondhandsongs.com .com 50
35,586 color-hex.com .com 51
35,598 zyukj2l.com .com 41
35,663 globalwitness.org .org 62
35,670 spine-health.com .com 74
35,684 americanrhetoric.com .com 45
35,692 hitmaal.tv .tv 71
35,723 wtvr.com .com 85
35,738 styry.com .com 82
35,742 xarxx.xxx .xxx 75
35,759 houseandgarden.co.uk .uk 81
35,760 montgomerycountymd.gov .gov 65
35,762 bubbl.us .us 69
35,763 penguin.de .de 88
35,800 wn.de .de 80
35,803 housepricesintheuk.co.uk .uk 74
35,805 hentaistube.com .com 68
35,828 dotdashmeredith.com .com 64
35,896 studylight.org .org 76
35,907 dailytimes.com.pk .pk 74
35,914 gaigu15.net .net 59
35,944 yomovies.institute .institute 70
35,953 redflagdeals.com .com 44
35,955 oekotest.de .de 86
35,976 bokepindo13.center .center 71
35,981 cuevana3.cl .cl 84
35,982 damconuong.mom .mom 82
35,995 hdmaal.to .to 55
36,001 koray.live .live 75
36,002 lapinede-aix.fr .fr 79
36,008 mariatogel71.com .com 75
36,012 maza18.org .org 73
PreviousPage 8 of 12Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Google-Extended reference, the full census, and the JSON endpoint.