Blocklist · ImageSift (Hive)

Sites that block ImagesiftBot

817 of the 29,991 domains we have measured, 3%, disallow imagesiftbot at the site root in robots.txt. ImagesiftBot collects content that may be used to train a model.

Every domain here has withheld its content from ImageSift (Hive)'s training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

817 of 29,991 measured domains (3%) disallow imagesiftbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block ImagesiftBot", measured 2026-11-21. https://crawlcensus.com/blocked/imagesiftbot

The list 817 domains

RankDomainTLDAI access score
36,840 budgetbytes.com .com 80
36,895 uokik.gov.pl .pl 85
37,154 r777.net .net 51
37,209 23andme.org .org 98
37,262 foodnavigator.com .com 88
37,367 mittelbayerische.de .de 77
37,522 twinkl.com .com 37
37,547 bt.no .no 77
37,565 jinftry.com .com 73
37,613 unescap.org .org 72
37,643 bk333.app .app 51
38,118 abc30.com .com 81
38,129 11freunde.de .de 58
38,148 news-press.com .com 73
38,247 moviemaker.com .com 90
38,327 inforum.com .com 70
38,409 igt.com .com 48
38,476 jarir.com .com 77
38,507 bournemouthecho.co.uk .uk 79
38,519 kochbar.de .de 62
38,526 haystack.tv .tv 88
38,715 nvent.com .com 91
38,739 thueringer-allgemeine.de .de 82
38,945 postype.com .com 81
39,088 dearlottery.in .in 90
39,206 futurezone.de .de 86
39,210 thecentersquare.com .com 78
39,281 teltarif.de .de 86
39,303 watoday.com.au .au 75
39,369 santafenewmexican.com .com 76
39,393 zakzak.co.jp .jp 72
39,471 vwvortex.com .com 43
39,566 xlovecam.com .com 90
39,657 korben.info .info 77
39,706 indiehackers.com .com 54
39,824 werstreamt.es .es 59
39,950 dholding.ru .ru 56
39,991 101hotels.com .com 83
40,219 thegrio.com .com 89
40,317 iza.ne.jp .jp 79
40,328 bntu.by .by 80
40,339 kompas.tv .tv 76
40,392 vanguardia.com.mx .mx 84
40,495 yahoo.com.tw .tw 59
40,512 thetelegraphandargus.co.uk .uk 78
40,536 snl.no .no 87
40,638 main-echo.de .de 64
40,713 dwds.de .de 64
40,726 flashscoreusa.com .com 71
40,741 theblast.com .com 92
40,796 elpasotimes.com .com 73
40,805 straight.com .com 79
40,874 grid.id .id 64
40,904 nesn.com .com 73
40,968 kontan.co.id .id 77
40,969 nrn.com .com 81
41,088 ispe.org .org 67
41,121 lancashiretelegraph.co.uk .uk 78
41,232 chipsmall.com .com 82
41,295 newson6.com .com 82
41,336 archinect.com .com 68
41,394 capitalizemytitle.com .com 71
41,489 findmypast.co.uk .uk 77
41,519 greenme.it .it 82
41,542 oefb.at .at 50
41,603 lci.fr .fr 84
41,647 cjonline.com .com 73
41,653 donaukurier.de .de 78
41,678 usna.edu .edu 71
41,713 roanoke.com .com 80
41,736 eadt.co.uk .uk 79
41,826 defcon.org .org 66
41,934 crikey.com.au .au 88
41,958 theledger.com .com 74
41,980 aqi.in .in 75
41,999 slub-dresden.de .de 71
42,054 lecker.de .de 88
42,076 iex.nl .nl 48
42,112 news9.com .com 85
42,113 glasgowtimes.co.uk .uk 79
42,160 tcpalm.com .com 73
42,227 vente-unique.com .com 93
42,260 rcgroups.com .com 41
42,262 advrider.com .com 41
42,614 citizen-times.com .com 74
42,651 computerwoche.de .de 85
42,682 opinautos.com .com 52
42,698 sol.no .no 74
42,728 wishtv.com .com 80
42,862 horseracingnation.com .com 72
42,863 textstudio.com .com 74
43,132 jtbc.co.kr .kr 70
43,140 gimmesomeoven.com .com 88
43,207 tv4play.se .se 77
43,268 candlepowerforums.com .com 61
43,281 xvix.eu .eu 75
43,302 seacoastonline.com .com 69
43,315 stateline.org .org 69
43,548 tvmovie.de .de 89
43,616 appian.com .com 77
43,633 rexel.fr .fr 69
43,715 carsdirect.com .com 86
43,890 21jingji.com .com 65
43,986 nn.de .de 83
43,996 supermarketnews.com .com 82
44,026 gainesville.com .com 66
44,077 airbnb.jp .jp 58
44,104 airbnb.nl .nl 58
44,183 barcablaugranes.com .com 68
44,228 notionpress.com .com 64
44,246 rubylane.com .com 29
44,252 braunschweiger-zeitung.de .de 65
44,255 cagesideseats.com .com 72
44,723 dailygazette.com .com 80
44,807 gofeminin.de .de 74
44,837 winelab.ru .ru 72
44,860 airbnb.co.za .za 58
44,874 news-leader.com .com 62
44,928 wgt.com .com 80
44,968 savannahnow.com .com 64
45,002 babycentre.co.uk .uk 62
45,064 erepublik.com .com 62
45,133 northdata.com .com 81
45,150 samplefocus.com .com 60
45,154 refurbed.de .de 88
45,158 autoguide.com .com 87
45,159 lansingstatejournal.com .com 62
45,298 osapublishing.org .org 65
45,316 eumetsat.int .int 80
45,349 wp.de .de 65
45,390 tupalo.com .com 57
45,440 nrz.de .de 80
45,536 bvb-alyans.ru .ru 80
45,571 wz.de .de 76
45,578 chugoku-np.co.jp .jp 80
45,604 beaconjournal.com .com 66
45,615 confidentialphonelookup.com .com 60
45,680 greenvilleonline.com .com 62
45,716 ithome.com.tw .tw 56
45,762 autozeitung.de .de 86
45,846 amazon.jp .jp 40
45,989 aftenbladet.no .no 78
46,154 airbnb.com.co .co 58
46,168 bizapedia.com .com 60
46,169 airbnb.mx .mx 58
46,209 rosebikes.de .de 81
46,231 registerguard.com .com 66
46,314 backpacker.com .com 78
46,342 pjstar.com .com 66
46,360 pnj.com .com 62
46,361 ceeol.com .com 66
46,490 djmag.com .com 65
46,495 sowetan.co.za .za 82
46,635 wikihow.life .life 76
46,753 grfc.ru .ru 50
46,923 alisweb.org .org 39
46,938 csfd.sk .sk 47
46,949 schulferien.org .org 51
46,990 fixya.com .com 43
46,994 ruslania.com .com 62
47,024 airbnb.co.kr .kr 59
47,029 lostarmour.info .info 51
47,173 eurogamer.de .de 57
47,206 jojowiki.com .com 83
47,285 bengo4.com .com 86
47,347 mafra.cz .cz 62
47,428 wealthmanagement.com .com 81
47,492 kittl.com .com 91
47,512 bestlawyers.com .com 89
47,526 allgaeuer-zeitung.de .de 81
47,659 nationalgeographic.de .de 82
47,741 salzburg24.at .at 85
47,796 topekalibraries.info .info 46
47,884 vcstar.com .com 62
48,046 trinidadexpress.com .com 74
48,074 grubstreet.com .com 81
48,102 airbnb.com.ar .ar 58
48,550 argusleader.com .com 62
48,585 fairview.org .org 68
48,589 airbnb.com.sg .sg 58
48,777 mtv.fi .fi 76
48,858 otz.de .de 65
48,859 castro.fm .fm 67
49,029 experts-exchange.com .com 68
49,061 posfie.com .com 73
49,194 mailonsunday.co.uk .uk 61
49,203 wikiroutes.info .info 73
49,245 startmycar.com .com 51
49,271 eltern.de .de 72
49,420 gds.it .it 77
49,501 sj-r.com .com 64
49,574 montgomeryadvertiser.com .com 62
49,611 gamedesire.com .com 85
49,766 jigidi.com .com 71
49,782 thedyrt.com .com 94
49,802 pazar3.mk .mk 73
49,883 transperfect.com .com 55
49,925 aamulehti.fi .fi 66
50,021 streamate.com .com 54
50,054 tekstowo.pl .pl 74
PreviousPage 4 of 5Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the ImagesiftBot reference, the full census, and the JSON endpoint.