Blocklist · Webz.io

Sites that block omgili

2,055 of the 29,991 domains we have measured, 7%, disallow omgili at the site root in robots.txt. omgili collects content that may be used to train a model.

Every domain here has withheld its content from Webz.io's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,055 of 29,991 measured domains (7%) disallow omgili at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block omgili", measured 2026-11-21. https://crawlcensus.com/blocked/omgili

The list 2,055 domains

RankDomainTLDAI access score
9,278 dorama.land .land 77
9,285 pkok11.com .com 52
9,310 komikindo.ch .ch 77
9,317 flashscore.com.ve .ve 69
9,320 flashscore.pe .pe 70
9,339 detroitnews.com .com 68
9,350 cv666.net .net 51
9,354 samehadaku.how .how 48
9,370 gogoroyal.com .com 71
9,388 law.com .com 68
9,447 loteriasdominicanas.com .com 49
9,492 freevideo.cz .cz 48
9,542 findnovel.net .net 64
9,565 nu.or.id .id 79
9,619 modaselvim.com .com 62
9,665 yakkun.com .com 68
9,676 leaktube.net .net 72
9,701 tamilgun.now .now 70
9,713 yupmanga.com .com 69
9,726 cdnfonts.com .com 65
9,769 freedot.info .info 40
9,787 futbol11.com .com 59
9,817 naijared.com .com 68
9,847 phimsexsuong3x.net .net 73
9,856 arbpay.me .me 41
9,885 wral.com .com 87
9,903 mk.co.kr .kr 82
9,907 erotikchat4free.org .org 37
9,925 iconify.design .design 55
9,946 xn--69-6tia3cb.net .net 80
9,948 xosothantai.mobi .mobi 75
9,981 xn--l3caaa5iqc3a.com .com 81
9,983 xn--72caa3cygoc0d9c.com .com 60
10,006 1goplus.com .com 58
10,020 scoalarutiera.ro .ro 63
10,046 xn--6-lve1d0cya6hb2e.com .com 58
10,052 adcam.org .org 41
10,083 animesalt.ac .ac 70
10,090 reviews.io .io 90
10,139 xn--y3ctaak9bb.com .com 80
10,157 ethiolottery.et .et 45
10,210 u-money.money .money 43
10,271 anonymised.io .io 97
10,289 interestingengineering.com .com 87
10,291 usmagazine.com .com 87
10,335 windowscentral.com .com 85
10,345 inews.co.uk .uk 67
10,400 morgenpost.de .de 81
10,409 nhm.ac.uk .uk 64
10,432 expansion.com .com 81
10,470 babycenter.com .com 62
10,495 financialpost.com .com 71
10,501 ocregister.com .com 80
10,527 bestwestern.com .com 54
10,539 bunkr.cr .cr 46
10,585 anyflip.com .com 56
10,596 uptodate.com .com 33
10,680 f-droid.org .org 63
10,781 47news.jp .jp 67
10,849 theme-fusion.com .com 71
10,852 embrapa.br .br 63
10,885 livestrong.com .com 80
10,894 augsburger-allgemeine.de .de 81
10,913 wyborcza.pl .pl 66
10,933 rts.ch .ch 69
10,934 huffingtonpost.fr .fr 81
10,952 informationweek.com .com 82
10,987 qu.ax .ax 63
11,033 flathub.org .org 87
11,062 rsf.org .org 62
11,145 lolalytics.com .com 60
11,147 intechopen.com .com 67
11,154 internshala.com .com 87
11,200 aftenposten.no .no 76
11,201 latercera.com .com 80
11,216 nola.com .com 64
11,217 businessinsider.de .de 76
11,244 stocktwits.com .com 82
11,255 whitebluerights.com .com 45
11,327 espn.co.uk .uk 48
11,338 koreatimes.co.kr .kr 99
11,349 posteo.de .de 67
11,367 abc7.com .com 81
11,389 cookiepro.com .com 75
11,390 pantone.com .com 78
11,405 svd.se .se 78
11,457 wnp.pl .pl 65
11,465 houstonchronicle.com .com 54
11,504 gamblingtherapy.org .org 87
11,516 cults3d.com .com 91
11,644 plurk.com .com 46
11,657 fishki.net .net 78
11,659 abendblatt.de .de 65
11,746 fextralife.com .com 87
11,827 timesunion.com .com 52
11,864 bitcoin.com .com 93
11,910 bcorporation.net .net 46
11,934 loksatta.com .com 85
12,001 winehq.org .org 57
12,055 nbcnewyork.com .com 33
12,113 bostonherald.com .com 78
12,154 g2288.com .com 55
12,262 acog.org .org 82
12,280 laut.fm .fm 54
12,286 westeros.org .org 60
12,294 ally.com .com 94
12,297 slideserve.com .com 82
12,377 delfi.ee .ee 57
12,410 7a0.com.br .br 56
12,441 novelfire.net .net 64
12,473 espn.com.do .do 48
12,521 mec.gov.br .br 43
12,533 indystar.com .com 73
12,550 kiplinger.com .com 85
12,607 joinhandshake.com .com 87
12,655 case-battle.tel .tel 53
12,694 androidpolice.com .com 83
12,722 arabnok.com .com 73
12,726 lalibre.be .be 83
12,743 extremetech.com .com 64
12,769 bokepsurga.com .com 45
12,786 tdxflix.fyi .fyi 75
12,795 cloudflare-quic.com .com 59
12,799 curbed.com .com 73
12,805 g777.ph .ph 44
12,806 speed-manga.net .net 78
12,822 iwara.tv .tv 30
12,839 3k.plus .plus 58
12,841 stltoday.com .com 80
12,863 qadcuteo.cc .cc 42
12,879 gamisco.com .com 58
12,892 priotopic.com .com 72
12,907 loadedfiles.org .org 57
12,921 playarenax.in .in 56
12,924 syfy.com .com 80
12,927 radiopaedia.org .org 53
12,972 noticiasaominuto.com .com 85
12,980 techtimes.com .com 73
12,990 nybooks.com .com 80
13,005 simpleflying.com .com 83
13,047 lunarclient.com .com 66
13,091 elle.fr .fr 69
13,131 ranker.com .com 78
13,176 iucnredlist.org .org 55
13,188 mobygames.com .com 68
13,201 hessenschau.de .de 87
13,213 hellomagazine.com .com 86
13,318 contentmarketinginstitute.com .com 82
13,355 marieclaire.com .com 85
13,380 flourish.studio .studio 92
13,381 bt4g.com .com 47
13,419 vancouversun.com .com 71
13,451 skyscrapercity.com .com 43
13,579 barcelona.cat .cat 82
13,660 thrillist.com .com 70
13,667 dispatch.com .com 74
13,668 torontosun.com .com 71
13,696 blackfaggot.online .online 42
13,719 payoneer.com .com 79
13,772 khan.co.kr .kr 72
13,783 creativebloq.com .com 87
13,792 sheknows.com .com 83
13,825 heraldscotland.com .com 81
13,840 writeablog.net .net 51
13,858 flashscore.co.za .za 70
13,860 francebleu.fr .fr 87
13,871 ilex.by .by 59
13,873 rappler.com .com 80
13,879 tennessean.com .com 74
13,882 vermont.gov .gov 73
13,930 myminifactory.com .com 38
13,932 bokepi.com .com 75
13,942 dnevnik.hr .hr 55
13,987 mydealz.de .de 79
14,009 abc7chicago.com .com 81
14,053 androidcentral.com .com 83
14,065 animesuge.cz .cz 71
14,079 wccftech.com .com 80
14,087 diepresse.com .com 80
14,090 simon.com .com 31
14,092 politiken.dk .dk 73
14,153 ikiru.wtf .wtf 67
14,163 car-part.com .com 49
14,168 ncaa.com .com 85
14,350 abc7ny.com .com 81
14,374 delfi.lv .lv 80
14,408 nbclosangeles.com .com 33
14,468 mediapart.fr .fr 84
14,470 gamedeveloper.com .com 83
14,491 aerzteblatt.de .de 69
14,562 nbcchicago.com .com 62
14,576 porn-sex-site.com .com 77
14,661 jalalive.news .news 82
14,709 dazeddigital.com .com 78
14,733 waz.de .de 82
14,774 zebzoub.com .com 58
14,790 bokepindo13.study .study 71
14,794 sexeti.com .com 59
14,809 auto-motor-und-sport.de .de 81
14,826 rockpapershotgun.com .com 58
PreviousPage 3 of 11Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the omgili reference, the full census, and the JSON endpoint.