Blocklist · You.com

Sites that block YouBot

876 of the 29,991 domains we have measured, 3%, disallow youbot at the site root in robots.txt. YouBot builds the index that decides whether the operator's assistant cites a page.

Every domain here has removed itself from You.com's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

876 of 29,991 measured domains (3%) disallow youbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block YouBot", measured 2026-11-22. https://crawlcensus.com/blocked/youbot

The list 876 domains

RankDomainTLDAI access score
45,680 greenvilleonline.com .com 62
45,771 larioja.com .com 83
45,846 amazon.jp .jp 40
45,850 gloucestershirelive.co.uk .uk 47
45,918 revistagq.com .com 81
45,989 aftenbladet.no .no 78
46,164 gazettelive.co.uk .uk 47
46,168 bizapedia.com .com 60
46,181 gardenersworld.com .com 82
46,231 registerguard.com .com 66
46,342 pjstar.com .com 66
46,360 pnj.com .com 62
46,495 sowetan.co.za .za 82
46,635 wikihow.life .life 76
46,765 plymouthherald.co.uk .uk 47
46,836 unibz.it .it 72
46,918 examinerlive.co.uk .uk 47
46,923 alisweb.org .org 39
46,949 schulferien.org .org 51
46,990 fixya.com .com 43
47,173 eurogamer.de .de 57
47,347 mafra.cz .cz 62
47,512 bestlawyers.com .com 89
47,526 allgaeuer-zeitung.de .de 81
47,624 lacucinaitaliana.it .it 81
47,659 nationalgeographic.de .de 82
47,741 salzburg24.at .at 85
47,796 topekalibraries.info .info 46
47,850 espinof.com .com 94
47,884 vcstar.com .com 62
47,909 moneyweek.com .com 86
48,046 trinidadexpress.com .com 74
48,074 grubstreet.com .com 81
48,129 komputerswiat.pl .pl 82
48,292 wellsky.com .com 74
48,380 wsls.com .com 85
48,404 lesoleil.com .com 69
48,444 vogue.com.tw .tw 81
48,480 xatakamovil.com .com 92
48,550 argusleader.com .com 62
48,585 fairview.org .org 68
48,777 mtv.fi .fi 76
48,858 otz.de .de 65
48,861 usi.edu .edu 76
49,065 ingramcontent.com .com 69
49,067 gqitalia.it .it 64
49,192 therichest.com .com 84
49,194 mailonsunday.co.uk .uk 61
49,271 eltern.de .de 72
49,279 presstelegram.com .com 80
49,343 hd.se .se 51
49,420 gds.it .it 77
49,501 sj-r.com .com 64
49,574 montgomeryadvertiser.com .com 62
49,879 fandomwire.com .com 67
49,925 aamulehti.fi .fi 66
50,021 streamate.com .com 54
50,076 dublinlive.ie .ie 47
50,125 echo24.cz .cz 69
50,278 burlingtonfreepress.com .com 62
50,312 mujerhoy.com .com 80
50,338 ohtuleht.ee .ee 65
50,367 blipfoto.com .com 57
50,520 womansworld.com .com 85
50,598 dailycal.org .org 74
50,667 charityjob.co.uk .uk 82
50,682 commonsense.org .org 86
50,684 gq.com.mx .mx 72
50,788 liverpool.com .com 47
50,916 motorcycle.com .com 83
50,919 japantravel.com .com 79
50,933 nwaonline.com .com 73
50,979 lopinion.fr .fr 81
50,982 nrtool.st .st 54
- asteroidsathome.net .net 64
- tds.net .net 53
PreviousPage 5 of 5

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the YouBot reference, the full census, and the JSON endpoint.