Blocklist · Google

Sites that block Google-CloudVertexBot

1,361 of the 29,991 domains we have measured, 5%, disallow google-cloudvertexbot at the site root in robots.txt. Google-CloudVertexBot fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from Google's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

1,361 of 29,991 measured domains (5%) disallow google-cloudvertexbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Google-CloudVertexBot", measured 2026-11-21. https://crawlcensus.com/blocked/google-cloudvertexbot

The list 1,361 domains

RankDomainTLDAI access score
8,692 olympusxyz.com .com 56
8,789 supremevalues.com .com 70
8,928 nottingham.ac.uk .uk 64
8,931 camel1.tv .tv 67
8,959 glamour.com .com 81
8,984 getmodsapk.com .com 75
9,017 hentai20.io .io 69
9,051 avjb.com .com 53
9,055 porn-comic.com .com 54
9,062 bluewin.ch .ch 66
9,069 wbur.org .org 81
9,130 2ch2.net .net 43
9,149 forth.gr .gr 60
9,200 nekopoi.care .care 56
9,242 zonatmo.org .org 63
9,264 aflamk1.net .net 57
9,277 hsex.tv .tv 53
9,278 dorama.land .land 77
9,302 macworld.com .com 85
9,310 komikindo.ch .ch 77
9,339 detroitnews.com .com 68
9,354 samehadaku.how .how 48
9,370 gogoroyal.com .com 71
9,388 law.com .com 68
9,447 loteriasdominicanas.com .com 49
9,492 freevideo.cz .cz 48
9,542 findnovel.net .net 64
9,565 nu.or.id .id 79
9,619 modaselvim.com .com 62
9,665 yakkun.com .com 68
9,676 leaktube.net .net 72
9,701 tamilgun.now .now 70
9,713 yupmanga.com .com 69
9,726 cdnfonts.com .com 65
9,769 freedot.info .info 40
9,787 futbol11.com .com 59
9,817 naijared.com .com 68
9,847 phimsexsuong3x.net .net 73
9,856 arbpay.me .me 41
9,907 erotikchat4free.org .org 37
9,925 iconify.design .design 55
9,946 xn--69-6tia3cb.net .net 80
9,948 xosothantai.mobi .mobi 75
9,981 xn--l3caaa5iqc3a.com .com 81
9,983 xn--72caa3cygoc0d9c.com .com 60
10,006 1goplus.com .com 58
10,020 scoalarutiera.ro .ro 63
10,046 xn--6-lve1d0cya6hb2e.com .com 58
10,052 adcam.org .org 41
10,083 animesalt.ac .ac 70
10,139 xn--y3ctaak9bb.com .com 80
10,157 ethiolottery.et .et 45
10,210 u-money.money .money 43
10,345 inews.co.uk .uk 67
10,409 nhm.ac.uk .uk 64
10,432 expansion.com .com 81
10,527 bestwestern.com .com 54
10,539 bunkr.cr .cr 46
10,552 self.com .com 68
10,708 vogue.co.uk .uk 79
10,826 bonappetit.com .com 82
10,849 theme-fusion.com .com 71
10,894 augsburger-allgemeine.de .de 81
11,062 rsf.org .org 62
11,145 lolalytics.com .com 60
11,154 internshala.com .com 87
11,201 latercera.com .com 80
11,242 teenvogue.com .com 82
11,255 whitebluerights.com .com 45
11,349 posteo.de .de 67
11,367 abc7.com .com 81
11,385 freundin.de .de 89
11,389 cookiepro.com .com 75
11,572 overheid.nl .nl 68
11,610 allure.com .com 84
11,644 plurk.com .com 46
11,910 bcorporation.net .net 46
12,001 winehq.org .org 57
12,154 g2288.com .com 55
12,262 acog.org .org 82
12,280 laut.fm .fm 54
12,286 westeros.org .org 60
12,410 7a0.com.br .br 56
12,441 novelfire.net .net 64
12,521 mec.gov.br .br 43
12,533 indystar.com .com 73
12,542 epicurious.com .com 64
12,655 case-battle.tel .tel 53
12,722 arabnok.com .com 73
12,769 bokepsurga.com .com 45
12,786 tdxflix.fyi .fyi 75
12,795 cloudflare-quic.com .com 59
12,797 golem.de .de 65
12,799 curbed.com .com 73
12,805 g777.ph .ph 44
12,806 speed-manga.net .net 78
12,822 iwara.tv .tv 30
12,839 3k.plus .plus 58
12,863 qadcuteo.cc .cc 42
12,879 gamisco.com .com 58
12,892 priotopic.com .com 72
12,907 loadedfiles.org .org 57
12,921 playarenax.in .in 56
12,927 radiopaedia.org .org 53
12,980 techtimes.com .com 73
12,990 nybooks.com .com 80
13,047 lunarclient.com .com 66
13,169 csoonline.com .com 86
13,176 iucnredlist.org .org 55
13,188 mobygames.com .com 68
13,381 bt4g.com .com 47
13,398 gq-magazine.co.uk .uk 81
13,579 barcelona.cat .cat 82
13,660 thrillist.com .com 70
13,667 dispatch.com .com 74
13,696 blackfaggot.online .online 42
13,719 payoneer.com .com 79
13,840 writeablog.net .net 51
13,860 francebleu.fr .fr 87
13,871 ilex.by .by 59
13,879 tennessean.com .com 74
13,930 myminifactory.com .com 38
13,932 bokepi.com .com 75
13,942 dnevnik.hr .hr 55
14,009 abc7chicago.com .com 81
14,065 animesuge.cz .cz 71
14,153 ikiru.wtf .wtf 67
14,163 car-part.com .com 49
14,350 abc7ny.com .com 81
14,576 porn-sex-site.com .com 77
14,661 jalalive.news .news 82
14,709 dazeddigital.com .com 78
14,774 zebzoub.com .com 58
14,790 bokepindo13.study .study 71
14,794 sexeti.com .com 59
14,828 autotrader.ca .ca 81
14,833 katmoviehd.top .top 70
14,873 rareanimes.mov .mov 72
14,878 postheaven.net .net 54
14,902 xn--3-wxfc3gwbi.net .net 77
14,903 2osb.com .com 48
14,904 kyalsin.com .com 47
14,931 cossunex.com .com 59
14,973 lek-manga.net .net 68
14,976 glvietsub.net .net 82
14,982 finrezo.com .com 56
15,027 desidisini.space .space 26
15,046 drbokep.top .top 71
15,056 dindadisini.space .space 26
15,061 jnedemure.com .com 69
15,064 leadsafrica.com .com 56
15,067 rapbeh.cx .cx 35
15,068 toonstream.vip .vip 56
15,076 analdin.com .com 44
15,146 aldat.online .online 39
15,211 zenwriting.net .net 56
15,215 sportngin.com .com 84
15,218 statesman.com .com 51
15,293 abc7news.com .com 81
15,336 axiombid.com .com 73
15,366 filmix.my .my 72
15,372 letudiant.fr .fr 81
15,401 desmoinesregister.com .com 74
15,421 mtggoldfish.com .com 63
15,467 betsapi.com .com 59
15,486 angkanet22.com .com 63
15,488 nagawinplus.com .com 69
15,490 vidleey.sbs .sbs 43
15,491 wetheleader.org .org 65
15,508 ppy.sh .sh 59
15,511 chocolatey.org .org 61
15,557 cincinnati.com .com 74
15,570 finna.fi .fi 54
15,626 moviesmod.army .army 35
15,650 asd.ink .ink 79
15,668 azoramoon.com .com 73
15,671 narto-drama.com .com 41
15,679 opendota.com .com 42
15,697 xn--3-wxfc3gwbi.com .com 77
15,700 1x1x5.com .com 55
15,710 yourstory.com .com 55
15,723 disboard.org .org 52
15,743 alexistogel.link .link 66
15,744 alexistogel.mobi .mobi 74
15,745 alexistogel.news .news 76
15,746 alexistogel.red .red 76
15,747 alexistogel.team .team 78
15,748 alexistogel.tips .tips 76
15,752 kuttymovies1.fast .fast 54
15,760 vildey.space .space 43
15,782 gamesview.shop .shop 70
15,804 moviesda.bet .bet 56
15,806 tamilprint61.art .art 55
15,830 xn--3-7wf9a3c4b3bt8f0cya.net .net 77
15,834 bokepindo13.party .party 71
15,853 1tamilmv.cards .cards 74
15,856 aagmaal.bet .bet 72
15,857 aghazno11.com .com 80
15,858 alexistogel.lol .lol 73
15,867 holoo11.com .com 84
PreviousPage 2 of 7Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Google-CloudVertexBot reference, the full census, and the JSON endpoint.