Blocklist · Google

Sites that block Google-CloudVertexBot

1,361 of the 29,991 domains we have measured, 5%, disallow google-cloudvertexbot at the site root in robots.txt. Google-CloudVertexBot fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from Google's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

1,361 of 29,991 measured domains (5%) disallow google-cloudvertexbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Google-CloudVertexBot", measured 2026-11-21. https://crawlcensus.com/blocked/google-cloudvertexbot

The list 1,361 domains

RankDomainTLDAI access score
30,986 commercialappeal.com .com 74
31,023 phoenixnewtimes.com .com 71
31,057 linksbird.co .co 54
31,145 knowing-jesus.com .com 70
31,195 birdlife.org .org 73
31,231 grupofpsinais.bet .bet 54
31,232 omicaso.org .org 58
31,282 vndb.org .org 60
31,284 publicdomainpictures.net .net 68
31,293 mcsweeneys.net .net 78
31,320 lumendatabase.org .org 51
31,373 yugiyu2.com .com 56
31,391 xn--l3cly6b0fd0c.net .net 76
31,392 batikloreng.online .online 76
31,425 ewtnnews.com .com 70
31,434 xxxtubevideos.click .click 61
31,441 yacenetv.com .com 83
31,443 saarbruecker-zeitung.de .de 82
31,445 kingviral.baby .baby 72
31,458 cricfytvap.net .net 78
31,475 tmll7.com .com 53
31,533 krishitalk.com .com 56
31,549 lohud.com .com 74
31,565 alexiskian.com .com 70
31,566 apinagadigital.com .com 64
31,571 dailyroutine.lifestyle .lifestyle 30
31,582 gamenila.com .com 56
31,591 lottosociety.com .com 75
31,593 me.game .game 36
31,598 pahindot.me .me 77
31,602 quickplayhub.in .in 56
31,623 videyli.co .co 26
31,628 xvidey.top .top 53
31,686 one-name.net .net 29
31,758 are.na .na 72
31,782 mastodon.online .online 49
31,786 thespec.com .com 64
31,799 wefut.com .com 50
31,908 lamag.com .com 78
31,986 gamemaker.io .io 72
32,183 tellmyroute.com .com 72
32,201 bookriot.com .com 79
32,345 opencv.org .org 66
32,388 rgj.com .com 73
32,391 prweek.com .com 51
32,437 hoopshype.com .com 70
32,456 currencyrate.today .today 67
32,484 project1999.com .com 47
32,579 dallasobserver.com .com 77
32,595 saveur.com .com 70
32,605 thecrag.com .com 48
32,617 flo.com.tr .tr 52
32,718 athletic.net .net 68
32,790 tatler.com .com 82
32,824 datasheetbank.com .com 49
32,919 brighttalk.com .com 68
32,921 fs.blog .blog 80
32,935 svtperformance.com .com 75
32,951 amoxibest.top .top 79
33,018 hugo-spielautomat.com .com 73
33,072 tympanus.net .net 65
33,084 afi.com .com 49
33,179 srvb1.com .com 35
33,243 vgen.co .co 52
33,285 marketresearch.com .com 72
33,323 ftdichip.com .com 75
33,354 pucrs.br .br 72
33,364 merca20.com .com 79
33,430 ilmanifesto.it .it 68
33,559 bmwfans.info .info 56
33,572 diariodolitoral.com.br .br 70
33,597 onlinesequencer.net .net 45
33,845 mqseries.net .net 55
33,856 aciprensa.com .com 71
33,915 b254.com .com 54
33,953 annapurnabhandarwb.com .com 86
33,954 avxtha.com .com 74
33,961 ogomovies2.com .com 82
33,966 zonexa.xyz .xyz 73
34,089 metopera.org .org 31
34,097 vogue.es .es 65
34,148 asianfanfics.com .com 58
34,156 clickon.pro .pro 57
34,236 welib.st .st 47
34,301 stevehoffman.tv .tv 65
34,309 unionleader.com .com 63
34,372 cafemom.com .com 76
34,375 columbian.com .com 78
34,380 fitforfun.de .de 89
34,405 myfwc.com .com 65
34,445 monoskop.org .org 43
34,528 multimovies.makeup .makeup 75
34,621 ifad.org .org 69
34,636 upmsp.edu.in .in 54
34,669 allporncomics.co .co 64
34,750 mailplus.co.uk .uk 44
34,816 bokepking.cam .cam 81
34,847 sydsvenskan.se .se 52
34,959 tmd.go.th .th 49
34,961 volksfreund.de .de 83
34,963 ipcamlive.com .com 60
34,973 naplesnews.com .com 73
34,991 monkeyvillage.pro .pro 35
34,995 hiphopkit.com .com 72
35,033 online-literature.com .com 47
35,058 gaoding.com .com 62
35,120 hurawatch.cx .cx 86
35,122 jiaci.org .org 52
35,165 mldkyt.com .com 50
35,306 natega-eg.net .net 48
35,364 road.cc .cc 84
35,383 alexishave.com .com 66
35,387 alexistogel.ninja .ninja 72
35,388 arabxn.watch .watch 77
35,389 auntymaza.wiki .wiki 70
35,395 dutasexx.bond .bond 79
35,397 egy.sex .sex 58
35,403 makmur76.digital .digital 75
35,413 socialsecuritywb.com .com 75
35,416 under250art.ca .ca 79
35,488 seminarycentral.org .org 57
35,504 unityroom.com .com 53
35,519 youglish.com .com 59
35,530 comicland.org .org 49
35,543 news-journalonline.com .com 73
35,565 lectormangass.com .com 77
35,579 secondhandsongs.com .com 50
35,586 color-hex.com .com 51
35,598 zyukj2l.com .com 41
35,663 globalwitness.org .org 62
35,670 spine-health.com .com 74
35,692 hitmaal.tv .tv 71
35,738 styry.com .com 82
35,742 xarxx.xxx .xxx 75
35,759 houseandgarden.co.uk .uk 81
35,762 bubbl.us .us 69
35,803 housepricesintheuk.co.uk .uk 74
35,805 hentaistube.com .com 68
35,914 gaigu15.net .net 59
35,944 yomovies.institute .institute 70
35,976 bokepindo13.center .center 71
35,981 cuevana3.cl .cl 84
35,982 damconuong.mom .mom 82
35,995 hdmaal.to .to 55
36,001 koray.live .live 75
36,002 lapinede-aix.fr .fr 79
36,008 mariatogel71.com .com 75
36,012 maza18.org .org 73
36,013 mdg188sky.site .site 74
36,017 moviezmad.live .live 71
36,022 partaitogel76.com .com 73
36,038 rogmovies.work .work 61
36,050 ssrmovies.ch .ch 59
36,053 teensexmix.cyou .cyou 71
36,055 thereissearch.com .com 60
36,059 toto12ace.com .com 74
36,060 toto12sphynx.org .org 79
36,068 vinahentai.bond .bond 84
36,069 vinahentai.cloud .cloud 84
36,075 xmazaa.io .io 66
36,154 hashthemes.com .com 82
36,172 tfw2005.com .com 73
36,181 nsn-now.com .com 46
36,205 fair.org .org 54
36,225 gomotionapp.com .com 84
36,269 inkl.com .com 50
36,334 ytmnd.com .com 41
36,356 elgaronline.com .com 45
36,359 nasaspaceflight.com .com 66
36,370 shindanmaker.com .com 51
36,436 liquor.com .com 77
36,449 aek365.org .org 61
36,539 nd-aktuell.de .de 78
36,568 bookcrossing.com .com 38
36,590 fagerneek.com .com 57
36,668 uqload.is .is 61
36,737 moneyhouse.ch .ch 72
36,743 fcps.edu .edu 64
36,768 mamshirt.com .com 57
36,770 vturb.com .com 55
36,778 cwmars.org .org 43
36,800 pedigreedatabase.com .com 63
36,818 wssolver.net .net 62
36,827 verdi.de .de 58
36,838 globalprimereport.com .com 42
36,872 medical-xprt.com .com 54
36,926 globalpost.com .com 83
36,980 rak8s.com .com 49
37,032 asahq.org .org 62
37,070 073m.com .com 52
37,152 stuttgart.de .de 71
37,158 viddler.com .com 78
37,321 thesamba.com .com 42
37,323 esquire.de .de 89
37,342 eternalmangas.org .org 77
37,411 desisex.xxx .xxx 65
37,429 imfdb.org .org 47
37,456 theicct.org .org 72
37,478 sslshopper.com .com 61
37,522 twinkl.com .com 37
PreviousPage 5 of 7Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Google-CloudVertexBot reference, the full census, and the JSON endpoint.