Blocklist · ImageSift (Hive)

Sites that block ImagesiftBot

817 of the 29,991 domains we have measured, 3%, disallow imagesiftbot at the site root in robots.txt. ImagesiftBot collects content that may be used to train a model.

Every domain here has withheld its content from ImageSift (Hive)'s training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

817 of 29,991 measured domains (3%) disallow imagesiftbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block ImagesiftBot", measured 2026-11-21. https://crawlcensus.com/blocked/imagesiftbot

The list 817 domains

RankDomainTLDAI access score
26 amazon.com .com 40
58 yahoo.com .com 67
62 msn.com .com 41
79 vimeo.com .com 72
121 amazonvideo.com .com 55
160 tumblr.com .com 41
190 cnn.com .com 50
193 theguardian.com .com 60
260 launchpad.net .net 52
278 forter.com .com 93
281 nature.com .com 56
282 weather.com .com 86
318 amazon.co.uk .uk 40
377 amazon.de .de 40
494 amazon.co.jp .jp 40
499 aol.com .com 66
556 alrosa.ru .ru 68
571 uol.com.br .br 82
609 amazon.fr .fr 40
621 sagepub.com .com 87
623 amazon.co.za .za 40
627 dailymail.co.uk .uk 61
635 amazon.ca .ca 40
659 amazon.in .in 40
662 cnet.com .com 79
671 lemonde.fr .fr 81
681 dailymail.com .com 61
682 primevideo.com .com 71
706 amazon.it .it 40
725 amazon.es .es 40
726 ted.com .com 70
749 airbnb.com .com 36
763 bild.de .de 81
812 amazon.com.au .au 40
815 theverge.com .com 77
833 amazon.com.br .br 40
882 latimes.com .com 83
926 genius.com .com 65
942 repubblica.it .it 85
955 corriere.it .it 63
983 elmundo.es .es 84
1,019 theconversation.com .com 62
1,032 amazon.com.mx .mx 40
1,042 spiegel.de .de 64
1,056 marca.com .com 85
1,073 bfmtv.com .com 81
1,074 flashscore.com .com 73
1,083 nypost.com .com 81
1,098 franceinfo.fr .fr 60
1,104 idnes.cz .cz 80
1,105 cookpad.com .com 73
1,177 pimpbunny.com .com 56
1,189 aftonbladet.se .se 77
1,208 vg.no .no 79
1,223 furaffinity.net .net 39
1,272 vietnam.vn .vn 74
1,300 f95zone.to .to 59
1,305 dw.com .com 42
1,376 dagbladet.no .no 74
1,381 ilmeteo.it .it 87
1,394 usnews.com .com 83
1,409 iltalehti.fi .fi 58
1,456 eenadu.net .net 67
1,613 arabx.cam .cam 66
1,624 flashscore.mobi .mobi 69
1,640 flashscore.fr .fr 71
1,676 livescore.cz .cz 69
1,831 zdnet.com .com 76
1,835 wikihow.com .com 76
1,984 themoviedb.org .org 74
1,993 ign.com .com 62
2,006 amazon.eg .eg 40
2,010 mashable.com .com 61
2,039 rtve.es .es 85
2,230 meb.gov.tr .tr 66
2,299 guardian.co.uk .uk 60
2,325 nrk.no .no 69
2,351 diretta.it .it 70
2,423 pcmag.com .com 63
2,508 yr.no .no 64
2,530 smh.com.au .au 82
2,561 technologyreview.com .com 82
2,691 newscientist.com .com 76
2,723 yumpu.com .com 30
2,838 mastodon.social .social 49
2,880 sueddeutsche.de .de 71
2,975 imageshack.us .us 71
3,179 crunchbase.com .com 71
3,198 metro.co.uk .uk 59
3,286 flipboard.com .com 64
3,342 lifehacker.com .com 65
3,371 nymag.com .com 74
3,457 telstra.com .com 88
3,463 postman.com .com 92
3,499 amazon.se .se 40
3,520 amazon.ae .ae 40
3,542 orf.at .at 69
3,595 politico.eu .eu 62
3,598 amazon.nl .nl 40
3,603 macomnet.ru .ru 63
3,642 yahoo.net .net 67
3,717 ansa.it .it 85
3,869 pcworld.com .com 84
3,909 aol.de .de 65
3,963 nos.nl .nl 69
4,014 eurekalert.org .org 48
4,061 screenrant.com .com 84
4,065 seekingalpha.com .com 91
4,108 howtogeek.com .com 84
4,161 kompas.com .com 77
4,304 tvtropes.org .org 55
4,354 computerworld.com .com 83
4,512 amazon.com.tr .tr 40
4,551 yna.co.kr .kr 87
4,592 lastampa.it .it 81
4,749 teacherspayteachers.com .com 69
4,816 polygon.com .com 83
4,864 kinoafisha.info .info 91
5,037 imageshack.com .com 71
5,096 nine.com.au .au 71
5,146 everydayhealth.com .com 60
5,153 theage.com.au .au 75
5,223 oilprice.com .com 90
5,272 depositphotos.com .com 63
5,274 csmonitor.com .com 76
5,297 chinatimes.com .com 64
5,310 kotaku.com .com 89
5,547 amazon.ie .ie 40
5,678 dn.se .se 60
5,684 theepochtimes.com .com 80
5,714 francetvinfo.fr .fr 53
5,726 chefkoch.de .de 81
5,752 sankei.com .com 76
5,788 ibtimes.com .com 84
5,846 runescape.wiki .wiki 81
5,874 hs.fi .fi 68
5,879 cio.com .com 86
5,904 windstream.net .net 53
5,912 pagesix.com .com 80
5,936 qobuz.com .com 79
5,948 suntimes.com .com 81
6,042 sporcle.com .com 87
6,089 azcentral.com .com 74
6,159 instiz.net .net 58
6,180 tf1info.fr .fr 84
6,185 trustedshops.com .com 87
6,194 ifixit.com .com 73
6,228 sbnation.com .com 69
6,246 eurogamer.net .net 57
6,288 vulture.com .com 72
6,352 tv2.dk .dk 74
6,356 freep.com .com 73
6,361 ici.fr .fr 87
6,429 emol.com .com 70
6,504 telstra.com.au .au 86
6,512 telegram.com .com 73
6,522 eater.com .com 59
6,557 sportingnews.com .com 82
6,610 is.fi .fi 68
6,702 infoworld.com .com 83
6,737 altavista.com .com 53
6,781 csfd.cz .cz 47
6,793 svt.se .se 66
6,808 chunichi.co.jp .jp 71
6,816 maxroll.gg .gg 59
6,817 funnyjunk.com .com 52
6,895 togetter.com .com 73
6,922 livescore.in .in 71
6,948 nicematin.com .com 77
7,091 kathimerini.gr .gr 68
7,106 nrc.nl .nl 84
7,118 nme.com .com 81
7,119 rp-online.de .de 79
7,127 hani.co.kr .kr 67
7,178 sanspo.com .com 77
7,201 game8.jp .jp 72
7,239 gala.de .de 76
7,268 nzz.ch .ch 76
7,363 bhaskar.com .com 75
7,372 15min.lt .lt 74
7,396 outsideonline.com .com 79
7,432 nouvelobs.com .com 87
7,455 amazon.sg .sg 40
7,465 nationalgeographic.org .org 82
7,531 theonion.com .com 84
7,540 freeones.com .com 71
7,562 nettavisen.no .no 63
7,856 popsugar.com .com 75
7,863 refinery29.com .com 78
7,890 bustimes.org .org 68
7,975 elcinema.com .com 50
7,981 afr.com .com 72
7,993 njuskalo.hr .hr 86
8,032 metacritic.com .com 66
8,094 nefisyemektarifleri.com .com 76
8,160 javhdporn.net .net 71
8,173 leggo.it .it 62
8,207 flashscore.pl .pl 71
8,268 litmarket.ru .ru 87
8,285 chichi-pui.com .com 66
Page 1 of 5Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the ImagesiftBot reference, the full census, and the JSON endpoint.