Blocklist · Google

Sites that block Google-CloudVertexBot

1,361 of the 29,991 domains we have measured, 5%, disallow google-cloudvertexbot at the site root in robots.txt. Google-CloudVertexBot fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from Google's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

1,361 of 29,991 measured domains (5%) disallow google-cloudvertexbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Google-CloudVertexBot", measured 2026-11-21. https://crawlcensus.com/blocked/google-cloudvertexbot

The list 1,361 domains

RankDomainTLDAI access score
45,680 greenvilleonline.com .com 62
45,718 fanforum.com .com 47
45,786 topline.com .com 81
45,813 maza18.me .me 73
45,846 amazon.jp .jp 40
45,892 pvphq.com .com 43
45,902 fdfd.com .com 53
45,918 revistagq.com .com 81
46,008 alkamitech.com .com 80
46,094 kibibe.com .com 35
46,104 desihub.tv .tv 82
46,106 guildlaunch.com .com 54
46,107 javxxhd.com .com 73
46,128 svradv.com .com 46
46,134 interregeurope.eu .eu 60
46,168 bizapedia.com .com 60
46,210 i3investor.com .com 53
46,217 letsrun.com .com 68
46,231 registerguard.com .com 66
46,283 pcgamingwiki.com .com 70
46,301 redcafe.net .net 64
46,342 pjstar.com .com 66
46,360 pnj.com .com 62
46,409 are-we.co.uk .uk 79
46,458 voltairenet.org .org 65
46,496 veronalabs.com .com 83
46,502 adscientificindex.com .com 71
46,554 bollyflix.free .free 57
46,579 bdsmlr.com .com 41
46,596 soccerpunter.com .com 72
46,599 deutschlandcard.de .de 65
46,641 skyslope.com .com 72
46,691 drbokep18.com .com 71
46,713 dating.mobi .mobi 56
46,742 live-shows.net .net 53
46,779 miarroba.com .com 68
46,802 applicantpro.com .com 66
46,805 omroepwest.nl .nl 73
46,844 symbl.cc .cc 71
46,881 luluvid.com .com 51
46,923 alisweb.org .org 39
46,928 riba.org .org 59
47,029 lostarmour.info .info 51
47,161 pickaweb.co.uk .uk 62
47,202 parts55.com .com 51
47,243 alaphoid.com .com 57
47,281 ggjav.com .com 55
47,291 accelia.net .net 67
47,299 rtvdrenthe.nl .nl 73
47,355 cmsmasters.net .net 74
47,373 hentaienvy.com .com 65
47,374 f4wonline.com .com 64
47,393 networkofcare.org .org 53
47,424 harpersbazaar.de .de 89
47,516 novelcool.com .com 57
47,526 allgaeuer-zeitung.de .de 81
47,546 thequietus.com .com 78
47,604 gazetaexpress.com .com 68
47,624 lacucinaitaliana.it .it 81
47,703 play3.de .de 64
47,709 fomos.kr .kr 51
47,796 topekalibraries.info .info 46
47,879 onefivenine.com .com 46
47,884 vcstar.com .com 62
47,969 sunjournal.com .com 72
48,004 ukclimbing.com .com 67
48,057 eastasiaforum.org .org 70
48,074 grubstreet.com .com 81
48,084 jurnalul.ro .ro 82
48,222 taiwanus.net .net 51
48,235 first-server.net .net 63
48,246 kushub.net .net 26
48,298 pokebeach.com .com 66
48,418 fireant.vn .vn 48
48,444 vogue.com.tw .tw 81
48,446 dohaxe.com .com 37
48,485 danatoto91.com .com 72
48,515 hurawatch.sx .sx 86
48,528 dorar.net .net 58
48,539 smsbower.app .app 76
48,550 argusleader.com .com 62
48,613 theoutdoorstrader.com .com 52
48,667 ozsuper.com .com 36
48,782 bokepindo13.food .food 66
48,832 anoboy.xyz .xyz 78
48,833 alo-tech.com .com 77
48,876 chiangmaitourcenter.com .com 63
48,885 ventronchip.com .com 62
48,949 unison.org.uk .uk 64
49,019 diyaudio.com .com 37
49,037 bertrand.pt .pt 65
49,067 gqitalia.it .it 64
49,126 scientific.net .net 52
49,194 mailonsunday.co.uk .uk 61
49,209 slowfood.com .com 67
49,213 tarot.com .com 71
49,271 eltern.de .de 72
49,326 supercook.com .com 40
49,343 hd.se .se 51
49,363 mmganalytics.com .com 41
49,420 gds.it .it 77
49,449 cinehd.app .app 62
49,495 latoto91.com .com 74
49,501 sj-r.com .com 64
49,502 nagawinid.com .com 71
49,512 nzb.life .life 76
49,574 montgomeryadvertiser.com .com 62
49,575 stress.org .org 70
49,592 latintimes.com .com 72
49,688 olxsop.com .com 61
49,695 pricesmart.com .com 61
49,706 faymas.in .in 81
49,837 magma.com .com 58
49,903 beautifulhalo.com .com 58
49,925 aamulehti.fi .fi 66
50,001 toon-stream.site .site 56
50,063 textileexchange.org .org 70
50,070 retrogames.cz .cz 60
50,172 palworld-lab.com .com 65
50,180 banglanews24.com .com 72
50,210 rummyapklist.com .com 78
50,233 thefenomeno.com .com 74
50,240 moviezmad.cool .cool 71
50,278 burlingtonfreepress.com .com 62
50,314 thesportzfyapps.com .com 83
50,359 verticalresponse.com .com 92
50,367 blipfoto.com .com 57
50,417 vidoyyo.space .space 26
50,418 gagadget.com .com 72
50,461 gamioo5.com .com 56
50,478 scryfall.io .io 68
50,548 fakenamegenerator.com .com 71
50,579 cleopatraslot.org .org 69
50,682 commonsense.org .org 86
50,684 gq.com.mx .mx 72
50,854 rtcg.me .me 61
50,869 xn--4-wxfc3gwbi.com .com 77
50,877 movieinsider.com .com 70
50,891 damconuong.store .store 82
50,905 notice-facile.com .com 80
50,933 nwaonline.com .com 73
50,946 dutasexx.hair .hair 66
50,953 alaskantf.com .com 45
50,960 hot.com .com 67
50,982 nrtool.st .st 54
51,003 kenyans.co.ke .ke 78
51,018 everydaycalculation.com .com 52
- 0daymusic.org .org 52
- bettacasinos.com .com 86
- boracassino.com .com 84
- flashjournal.space .space 41
- headlinebeacon.site .site 43
- kemp-stokes-3.blogbright.net .net 46
- mexacasino.com .com 86
- misticasino.com .com 86
- myreadinglists.com .com 49
- rupacasino.com .com 86
- samplenightlive.com .com 75
- sdgyoungleaders.org .org 84
- thecip.org .org 39
- vetokasino.com .com 87
- winacasinos.com .com 84
PreviousPage 7 of 7

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Google-CloudVertexBot reference, the full census, and the JSON endpoint.