Blocklist · Google

Sites that block Google-CloudVertexBot

1,361 of the 29,991 domains we have measured, 5%, disallow google-cloudvertexbot at the site root in robots.txt. Google-CloudVertexBot fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from Google's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

1,361 of 29,991 measured domains (5%) disallow google-cloudvertexbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Google-CloudVertexBot", measured 2026-11-21. https://crawlcensus.com/blocked/google-cloudvertexbot

The list 1,361 domains

RankDomainTLDAI access score
23,270 depedclub.com .com 80
23,274 pilipinay.tv .tv 82
23,282 goctruyentranhvui30.com .com 64
23,298 fuegodevida.com .com 58
23,318 yoti.com .com 83
23,324 lunatogel78.com .com 75
23,328 pos4dtototogel84.com .com 70
23,343 tioeroge.com .com 76
23,360 pinaybold.tv .tv 76
23,365 hometogel72.com .com 72
23,368 ssrmovies.luxe .luxe 59
23,374 rojgarresult.com .com 82
23,389 wftoon221.com .com 44
23,392 hotdesifuck.pro .pro 61
23,401 olxexp.com .com 77
23,402 vldeys.space .space 35
23,442 playgamester.com .com 54
23,447 amnt-16d09m20y.com .com 35
23,452 cbunu.com .com 45
23,472 studyinsaudi.sa .sa 63
23,488 alexisboro.com .com 71
23,496 jps.go.cr .cr 33
23,519 vinahentai.club .club 84
23,545 alexissaddler.com .com 75
23,575 olxsos.com .com 83
23,582 alexismold.com .com 74
23,583 coloksgpaja.com .com 73
23,600 kawanpaitomember.com .com 58
23,613 nordbayern.de .de 81
23,630 olxtst.com .com 63
23,668 alexisverdugo.com .com 75
23,673 dingdongtogel91.com .com 74
23,689 3cr.game .game 60
23,699 alexisnemesis.com .com 71
23,700 alexisuro.com .com 71
23,701 badak178wind.live .live 47
23,703 olxpln.com .com 68
23,707 viideys.sbs .sbs 43
23,708 vildeey.space .space 43
23,715 1punrewudx.com .com 45
23,752 in.game .game 37
23,754 inviv.top .top 36
23,759 kingsofsatta.com .com 59
23,762 ldidyg.com .com 44
23,773 naychje.com .com 44
23,782 playindialottery.com .com 44
23,788 satta-king-live.com .com 76
23,790 sattamatka.email .email 84
23,795 shillongteergrounds.in .in 81
23,798 spinjeet365.com .com 36
23,964 pcwelt.de .de 78
24,022 twinkl.co.uk .uk 37
24,102 knoxnews.com .com 74
24,141 cntraveller.com .com 81
24,154 novaskin.me .me 51
24,190 jacksonville.com .com 74
24,233 glamourmagazine.co.uk .uk 81
24,307 ewtn.com .com 70
24,354 youtubers.me .me 70
24,505 megasmp.gg .gg 84
24,525 zin.ru .ru 41
24,593 vogue.in .in 64
24,603 globalknowledge.com .com 61
24,612 blogbright.net .net 53
24,657 blockshopper.com .com 57
24,661 librivox.org .org 55
24,733 humanite.fr .fr 87
24,744 advisor.travel .travel 46
24,747 jazz.com.pk .pk 46
24,853 nameswriter.com .com 48
24,878 happycolorapp.com .com 77
24,946 vogue.fr .fr 81
24,961 miaminewtimes.com .com 73
24,977 wired.it .it 83
25,031 franceculture.fr .fr 81
25,048 tokyo-np.co.jp .jp 81
25,131 ausfreeslots.com .com 77
25,133 myrecipes.com .com 77
25,221 cpubenchmark.net .net 70
25,299 pageloft.de .de 80
25,391 americastestkitchen.com .com 80
25,392 bsportsfan.com .com 76
25,478 franceinter.fr .fr 80
25,576 giraffic.com .com 75
25,602 behindthename.com .com 52
25,625 americanthinker.com .com 56
25,632 commonwealthfund.org .org 63
25,662 experiment.com .com 60
25,748 booru.org .org 54
25,776 zinio.com .com 76
25,797 wuytl.com .com 51
25,839 delawareonline.com .com 74
25,903 heraldtribune.com .com 73
25,911 arkansasonline.com .com 71
25,993 vivodemisrentas.net .net 57
26,108 kebirhost.com .com 79
26,114 democratandchronicle.com .com 73
26,155 attendanceondemand.com .com 60
26,322 gimkit.com .com 42
26,379 brisbanetimes.com.au .au 75
26,400 alternatehistory.com .com 62
26,408 xozilla.xxx .xxx 58
26,444 pap.pl .pl 39
26,474 mbta.com .com 64
26,505 astralane.io .io 83
26,558 tadex.id .id 63
26,637 brigitte.de .de 79
26,672 subscan.io .io 53
26,842 unherd.com .com 83
26,845 spin.com .com 70
26,853 tallahassee.com .com 74
27,001 mymrbet.com .com 75
27,105 unp.ac.id .id 76
27,108 marketingprofs.com .com 54
27,113 in3x.net .net 38
27,128 metapress.com .com 85
27,256 amny.com .com 83
27,275 unenvironment.org .org 68
27,344 ga.de .de 80
27,357 squareblogs.net .net 57
27,401 derstandard.de .de 56
27,551 latostadora.com .com 65
27,608 cortexbid.com .com 72
27,660 pokelike.xyz .xyz 65
27,696 staradvertiser.com .com 84
27,756 beatstars.net .net 51
27,796 asiasociety.org .org 67
27,838 mtvuutiset.fi .fi 72
27,891 blogto.com .com 67
27,906 usip.org .org 70
28,003 footballant.com .com 75
28,022 direct-book.com .com 45
28,047 biodiversitylibrary.org .org 50
28,074 wvdme.com .com 49
28,079 apsense.com .com 52
28,099 explained.today .today 42
28,170 suedkurier.de .de 81
28,336 cargoagent.net .net 51
28,349 suamusica.com.br .br 77
28,361 core77.com .com 57
28,377 menuweb.menu .menu 69
28,438 360cities.net .net 49
28,488 jsr.io .io 61
28,522 distance.to .to 57
28,616 amzn.com .com 40
28,676 xforum.live .live 60
28,729 famelack.com .com 81
28,740 ctt.pt .pt 54
28,754 nekobt.to .to 54
28,775 vogue.de .de 65
28,868 myvolumio.org .org 38
28,895 weatheronline.co.uk .uk 47
28,935 red-dot.org .org 74
28,950 acronymfinder.com .com 65
28,996 sebokep.vip .vip 78
29,031 threadreaderapp.com .com 59
29,048 gq-magazin.de .de 66
29,063 golzu.com .com 54
29,139 u-cursos.cl .cl 51
29,166 freakonomics.com .com 74
29,170 spinmagazine.com .com 79
29,260 b-cd.app .app 52
29,313 qbittorrent.org .org 50
29,341 geometrylitepc.io .io 70
29,402 mmafighting.com .com 68
29,447 artofproblemsolving.com .com 86
29,499 conjur.com.br .br 73
29,513 mindtos.com .com 57
29,551 lavoro.gov.it .it 63
29,562 therarbg.com .com 77
29,634 westword.com .com 77
29,661 nn125.com .com 49
29,700 gamessofun.com .com 50
29,821 providencejournal.com .com 73
29,991 efhub.com .com 55
30,049 processing.org .org 57
30,074 yugipedia.com .com 58
30,161 bostonmagazine.com .com 72
30,202 serializd.com .com 65
30,237 clarionledger.com .com 74
30,288 anycubic.com .com 68
30,301 qtoon.org .org 61
30,376 getxray.app .app 80
30,382 wook.pt .pt 57
30,387 bsc.es .es 37
30,393 ecode360.com .com 44
30,470 turbo.cr .cr 54
30,507 abc11.com .com 81
30,517 premioibest.com .com 70
30,588 streamimdb.ru .ru 72
30,678 xbato.co.uk .uk 73
30,698 nswpedia.com .com 75
30,703 wickedlocal.com .com 75
30,711 hi5.com .com 43
30,738 fedpat.com.ar .ar 69
30,864 umms.org .org 76
30,915 sendtuna.com .com 45
30,928 bokepindoh.party .party 71
30,974 techadvisor.com .com 85
30,976 tablegame.ph .ph 39
PreviousPage 4 of 7Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Google-CloudVertexBot reference, the full census, and the JSON endpoint.