Blocklist · ImageSift (Hive)

Sites that block ImagesiftBot

817 of the 29,991 domains we have measured, 3%, disallow imagesiftbot at the site root in robots.txt. ImagesiftBot collects content that may be used to train a model.

Every domain here has withheld its content from ImageSift (Hive)'s training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

817 of 29,991 measured domains (3%) disallow imagesiftbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block ImagesiftBot", measured 2026-11-21. https://crawlcensus.com/blocked/imagesiftbot

The list 817 domains

RankDomainTLDAI access score
8,287 javdock.com .com 65
8,364 eredmenyek.com .com 71
8,380 veikkaus.fi .fi 67
8,398 livesport.cz .cz 71
8,410 peakgames.net .net 87
8,435 thecut.com .com 84
8,450 complex.com .com 91
8,484 sciencenews.org .org 86
8,547 bqsex.com .com 71
8,560 presseportal.de .de 87
8,599 soccerway.com .com 73
8,675 typingtest.com .com 86
8,710 rezultati.com .com 71
8,799 hmetro.com.my .my 60
8,800 sefan.ru .ru 43
8,830 portalsamorzadowy.pl .pl 69
8,878 maxifoot.fr .fr 83
8,897 rynekzdrowia.pl .pl 64
8,899 flashscore.co.id .id 70
9,007 flashscore.co .co 69
9,051 avjb.com .com 53
9,060 alo.bg .bg 71
9,062 bluewin.ch .ch 66
9,068 airbnb.fr .fr 58
9,069 wbur.org .org 81
9,070 towardsdatascience.com .com 70
9,072 flashscore.ua .ua 70
9,094 flashscore.ro .ro 70
9,149 forth.gr .gr 60
9,196 flashscore.es .es 69
9,285 pkok11.com .com 52
9,302 macworld.com .com 85
9,317 flashscore.com.ve .ve 69
9,320 flashscore.pe .pe 70
9,339 detroitnews.com .com 68
9,350 cv666.net .net 51
9,352 turfomania.fr .fr 56
9,388 law.com .com 68
9,903 mk.co.kr .kr 82
10,191 paryajlakay.com .com 45
10,271 anonymised.io .io 97
10,289 interestingengineering.com .com 87
10,345 inews.co.uk .uk 67
10,400 morgenpost.de .de 81
10,432 expansion.com .com 81
10,470 babycenter.com .com 62
10,576 manuals.plus .plus 98
10,585 anyflip.com .com 56
10,596 uptodate.com .com 33
10,680 f-droid.org .org 63
10,885 livestrong.com .com 80
10,894 augsburger-allgemeine.de .de 81
10,913 wyborcza.pl .pl 66
10,934 huffingtonpost.fr .fr 81
10,952 informationweek.com .com 82
11,005 airbnb.co.uk .uk 58
11,107 bibliocommons.com .com 85
11,147 intechopen.com .com 67
11,200 aftenposten.no .no 76
11,201 latercera.com .com 80
11,216 nola.com .com 64
11,217 businessinsider.de .de 76
11,349 posteo.de .de 67
11,367 abc7.com .com 81
11,390 pantone.com .com 78
11,405 svd.se .se 78
11,457 wnp.pl .pl 65
11,504 gamblingtherapy.org .org 87
11,516 cults3d.com .com 91
11,657 fishki.net .net 78
11,659 abendblatt.de .de 65
11,864 bitcoin.com .com 93
12,297 slideserve.com .com 82
12,533 indystar.com .com 73
12,607 joinhandshake.com .com 87
12,743 extremetech.com .com 64
12,753 tvguide.com .com 70
12,799 curbed.com .com 73
12,841 stltoday.com .com 80
12,990 nybooks.com .com 80
13,018 uwm.edu .edu 91
13,131 ranker.com .com 78
13,169 csoonline.com .com 86
13,318 contentmarketinginstitute.com .com 82
13,333 wtop.com .com 74
13,347 search.ch .ch 62
13,380 flourish.studio .studio 92
13,451 skyscrapercity.com .com 43
13,579 barcelona.cat .cat 82
13,660 thrillist.com .com 70
13,667 dispatch.com .com 74
13,772 khan.co.kr .kr 72
13,825 heraldscotland.com .com 81
13,858 flashscore.co.za .za 70
13,860 francebleu.fr .fr 87
13,871 ilex.by .by 59
13,873 rappler.com .com 80
13,879 tennessean.com .com 74
13,882 vermont.gov .gov 73
14,009 abc7chicago.com .com 81
14,079 wccftech.com .com 80
14,087 diepresse.com .com 80
14,090 simon.com .com 31
14,112 project-syndicate.org .org 88
14,350 abc7ny.com .com 81
14,470 gamedeveloper.com .com 83
14,612 mopo.de .de 79
14,709 dazeddigital.com .com 78
14,733 waz.de .de 82
14,786 all.biz .biz 63
14,809 auto-motor-und-sport.de .de 81
14,826 rockpapershotgun.com .com 58
14,961 townnews.com .com 75
15,104 niu.edu .edu 88
15,174 pcgamesn.com .com 83
15,218 statesman.com .com 51
15,269 gamesindustry.biz .biz 57
15,293 abc7news.com .com 81
15,321 coursehero.com .com 76
15,322 honto.jp .jp 85
15,352 aaas.org .org 65
15,372 letudiant.fr .fr 81
15,391 netzwelt.de .de 84
15,401 desmoinesregister.com .com 74
15,476 computerbild.de .de 81
15,557 cincinnati.com .com 74
16,058 globalsecurity.org .org 58
16,082 t3n.de .de 78
16,223 smashwords.com .com 58
16,254 unil.ch .ch 83
16,283 positivepsychology.com .com 76
16,290 duden.de .de 71
16,317 ilmattino.it .it 62
16,377 decider.com .com 79
16,421 dejure.org .org 72
16,428 e24.no .no 78
16,444 hometalk.com .com 63
16,564 mapgenie.io .io 59
16,664 lightningmaps.org .org 51
16,698 airbnb.com.br .br 58
16,738 cnbctv18.com .com 84
16,796 postandcourier.com .com 77
16,803 buffalonews.com .com 80
16,814 whattoexpect.com .com 65
17,042 northjersey.com .com 74
17,183 semafor.com .com 72
17,266 letemps.ch .ch 74
17,469 palmbeachpost.com .com 73
17,489 dukeupress.edu .edu 73
17,492 ina.fr .fr 76
17,522 daangn.com .com 71
17,554 abc13.com .com 79
17,619 nst.com.my .my 42
17,694 manager-magazin.de .de 63
17,750 6abc.com .com 79
17,886 agrarheute.com .com 75
17,983 brightlocal.com .com 90
17,988 timeslive.co.za .za 80
18,071 flashscore.co.uk .uk 71
18,214 xxxbunker.com .com 81
18,280 hoerzu.de .de 45
18,442 empireonline.com .com 62
18,489 elcolombiano.com .com 83
18,522 thenews.com.pk .pk 65
18,549 gamasutra.com .com 83
18,687 romatoday.it .it 67
18,783 spanishdict.com .com 81
18,870 scotusblog.com .com 83
18,883 courier-journal.com .com 74
18,894 courrierinternational.com .com 83
19,189 airbnb.co.in .in 58
19,250 beatstars.com .com 51
19,283 denik.cz .cz 77
19,314 milanotoday.it .it 67
19,679 eheya.net .net 86
20,081 flashscore.com.tr .tr 70
20,158 bigdatacloud.net .net 97
20,318 supersport.hr .hr 51
20,362 thedodo.com .com 70
20,364 derwesten.de .de 83
20,419 01net.com .com 93
20,460 mt.co.kr .kr 93
20,467 23andme.com .com 98
20,481 flashscore.pt .pt 72
20,761 nlc.hu .hu 85
20,858 flashscore.vn .vn 72
21,004 femina.hu .hu 82
21,038 mainpost.de .de 80
21,042 wanderlog.com .com 89
21,231 epochtimes.com .com 85
21,267 seher.no .no 70
21,331 winbet.bg .bg 50
21,568 cvbankas.lt .lt 74
21,586 madison.com .com 80
21,692 wikidex.net .net 74
21,707 khronos.org .org 68
21,736 slate.fr .fr 68
21,742 capfun.com .com 89
21,823 desy.de .de 62
21,890 telerama.fr .fr 83
PreviousPage 2 of 5Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the ImagesiftBot reference, the full census, and the JSON endpoint.