Blocklist · ImageSift (Hive)

Sites that block ImagesiftBot

821 of the 30,152 domains we have measured, 3%, disallow imagesiftbot at the site root in robots.txt. ImagesiftBot collects content that may be used to train a model.

Every domain here has withheld its content from ImageSift (Hive)'s training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

821 of 30,152 measured domains (3%) disallow imagesiftbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-08-24 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block ImagesiftBot", measured 2026-08-24. https://crawlcensus.com/blocked/imagesiftbot

The list 821 domains

RankDomainTLDAI access score
35,953 redflagdeals.com .com 44
36,334 ytmnd.com .com 42
36,434 businessday.co.za .za 82
36,539 nd-aktuell.de .de 78
36,541 homebrewtalk.com .com 63
36,575 dailyecho.co.uk .uk 72
36,667 grindosaur.com .com 55
36,803 tennis.com .com 50
36,847 myspreadshop.de .de 53
36,895 uokik.gov.pl .pl 86
36,934 levels.fyi .fyi 72
37,106 falter.at .at 77
37,126 wdrb.com .com 66
37,154 r777.net .net 51
37,209 23andme.org .org 92
37,262 foodnavigator.com .com 88
37,367 mittelbayerische.de .de 77
37,522 twinkl.com .com 37
37,547 bt.no .no 78
37,565 jinftry.com .com 73
37,643 bk333.app .app 51
38,129 11freunde.de .de 75
38,148 news-press.com .com 73
38,247 moviemaker.com .com 90
38,257 4players.de .de 83
38,327 inforum.com .com 70
38,409 igt.com .com 49
38,476 jarir.com .com 81
38,507 bournemouthecho.co.uk .uk 71
38,526 haystack.tv .tv 88
38,739 thueringer-allgemeine.de .de 65
38,945 postype.com .com 82
39,022 maville.com .com 42
39,206 futurezone.de .de 85
39,210 thecentersquare.com .com 78
39,281 teltarif.de .de 86
39,303 watoday.com.au .au 75
39,369 santafenewmexican.com .com 76
39,393 zakzak.co.jp .jp 72
39,471 vwvortex.com .com 43
39,518 thegazette.com .com 76
39,566 xlovecam.com .com 90
39,824 werstreamt.es .es 52
39,950 dholding.ru .ru 56
39,991 101hotels.com .com 83
40,219 thegrio.com .com 89
40,317 iza.ne.jp .jp 79
40,328 bntu.by .by 77
40,339 kompas.tv .tv 81
40,495 yahoo.com.tw .tw 55
40,512 thetelegraphandargus.co.uk .uk 69
40,536 snl.no .no 87
40,638 main-echo.de .de 64
40,693 bonn.de .de 77
40,713 dwds.de .de 64
40,726 flashscoreusa.com .com 71
40,741 theblast.com .com 92
40,793 yorkpress.co.uk .uk 71
40,796 elpasotimes.com .com 73
40,874 grid.id .id 82
40,904 nesn.com .com 65
40,968 kontan.co.id .id 77
40,969 nrn.com .com 81
41,088 ispe.org .org 67
41,121 lancashiretelegraph.co.uk .uk 69
41,232 chipsmall.com .com 69
41,295 newson6.com .com 81
41,336 archinect.com .com 44
41,368 gunbark.dev .dev 36
41,489 findmypast.co.uk .uk 86
41,519 greenme.it .it 84
41,542 oefb.at .at 50
41,603 lci.fr .fr 84
41,647 cjonline.com .com 73
41,653 donaukurier.de .de 87
41,678 usna.edu .edu 71
41,713 roanoke.com .com 80
41,736 eadt.co.uk .uk 71
41,793 myspreadshop.co.uk .uk 53
41,826 defcon.org .org 66
41,838 wunderweib.de .de 87
41,918 peopleenespanol.com .com 77
41,934 crikey.com.au .au 88
41,958 theledger.com .com 74
41,999 slub-dresden.de .de 71
42,042 suaramerdeka.com .com 70
42,054 lecker.de .de 88
42,076 iex.nl .nl 65
42,112 news9.com .com 81
42,113 glasgowtimes.co.uk .uk 71
42,160 tcpalm.com .com 73
42,227 vente-unique.com .com 86
42,260 rcgroups.com .com 41
42,262 advrider.com .com 43
42,505 medietall.no .no 41
42,651 computerwoche.de .de 84
42,682 opinautos.com .com 52
42,728 wishtv.com .com 81
42,862 horseracingnation.com .com 72
43,010 baby-kingdom.com .com 60
43,132 jtbc.co.kr .kr 70
43,140 gimmesomeoven.com .com 88
43,207 tv4play.se .se 77
43,256 moly.hu .hu 49
43,268 candlepowerforums.com .com 81
43,281 xvix.eu .eu 68
43,284 ehealthme.com .com 68
43,315 stateline.org .org 70
43,548 tvmovie.de .de 89
43,616 appian.com .com 74
43,633 rexel.fr .fr 69
43,715 carsdirect.com .com 86
43,890 21jingji.com .com 64
43,986 nn.de .de 81
43,996 supermarketnews.com .com 82
44,077 airbnb.jp .jp 59
44,104 airbnb.nl .nl 59
44,183 barcablaugranes.com .com 68
44,228 notionpress.com .com 69
44,246 rubylane.com .com 29
44,252 braunschweiger-zeitung.de .de 65
44,255 cagesideseats.com .com 67
44,469 halkbank.com.tr .tr 98
44,723 dailygazette.com .com 79
44,807 gofeminin.de .de 80
44,837 winelab.ru .ru 63
44,855 greenwichmeantime.com .com 57
44,860 airbnb.co.za .za 59
45,002 babycentre.co.uk .uk 63
45,133 northdata.com .com 81
45,150 samplefocus.com .com 61
45,154 refurbed.de .de 88
45,158 autoguide.com .com 83
45,298 osapublishing.org .org 56
45,316 eumetsat.int .int 80
45,349 wp.de .de 65
45,378 essen-und-trinken.de .de 75
45,440 nrz.de .de 63
45,571 wz.de .de 63
45,578 chugoku-np.co.jp .jp 80
45,615 confidentialphonelookup.com .com 60
45,716 ithome.com.tw .tw 56
45,762 autozeitung.de .de 86
45,838 calculator.name .name 69
45,846 amazon.jp .jp 40
45,854 sibur.ru .ru 64
45,989 aftenbladet.no .no 78
46,154 airbnb.com.co .co 59
46,168 bizapedia.com .com 52
46,169 airbnb.mx .mx 59
46,209 rosebikes.de .de 84
46,231 registerguard.com .com 66
46,314 backpacker.com .com 69
46,342 pjstar.com .com 66
46,360 pnj.com .com 62
46,495 sowetan.co.za .za 82
46,635 wikihow.life .life 76
46,923 alisweb.org .org 31
46,938 csfd.sk .sk 47
46,939 southwalesargus.co.uk .uk 69
46,949 schulferien.org .org 59
46,990 fixya.com .com 43
46,994 ruslania.com .com 62
47,024 airbnb.co.kr .kr 60
47,067 branchen-info.net .net 77
47,166 tu.berlin .berlin 64
47,173 eurogamer.de .de 57
47,206 jojowiki.com .com 75
47,228 newsandstar.co.uk .uk 71
47,285 bengo4.com .com 86
47,347 mafra.cz .cz 62
47,428 wealthmanagement.com .com 81
47,492 kittl.com .com 88
47,512 bestlawyers.com .com 89
47,526 allgaeuer-zeitung.de .de 73
47,659 nationalgeographic.de .de 80
47,725 lasillavacia.com .com 76
47,739 sportler.com .com 64
47,741 salzburg24.at .at 86
47,796 topekalibraries.info .info 38
47,884 vcstar.com .com 62
48,046 trinidadexpress.com .com 65
48,058 myspreadshop.net .net 53
48,074 grubstreet.com .com 73
48,102 airbnb.com.ar .ar 59
48,550 argusleader.com .com 62
48,589 airbnb.com.sg .sg 59
48,777 mtv.fi .fi 76
48,858 otz.de .de 65
48,859 castro.fm .fm 67
49,029 experts-exchange.com .com 54
49,061 posfie.com .com 73
49,194 mailonsunday.co.uk .uk 57
49,203 wikiroutes.info .info 73
49,245 startmycar.com .com 52
49,271 eltern.de .de 74
49,420 gds.it .it 77
49,501 sj-r.com .com 64
49,574 montgomeryadvertiser.com .com 62
49,611 gamedesire.com .com 85
PreviousPage 4 of 5Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the ImagesiftBot reference, the full census, and the JSON endpoint.