Blocklist · ImageSift (Hive)

Sites that block ImagesiftBot

817 of the 29,991 domains we have measured, 3%, disallow imagesiftbot at the site root in robots.txt. ImagesiftBot collects content that may be used to train a model.

Every domain here has withheld its content from ImageSift (Hive)'s training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

817 of 29,991 measured domains (3%) disallow imagesiftbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block ImagesiftBot", measured 2026-11-21. https://crawlcensus.com/blocked/imagesiftbot

The list 817 domains

RankDomainTLDAI access score
21,999 dailyhive.com .com 74
22,007 vg247.com .com 58
22,016 canva.in .in 86
22,028 distrowatch.com .com 44
22,149 airbnb.ca .ca 58
22,216 airliners.net .net 44
22,272 geograph.org.uk .uk 84
22,365 petitesannonces.ch .ch 67
22,476 gruposwats.com .com 54
22,596 flashscore.gr .gr 72
22,867 fb77.one .one 50
22,938 congobet.net .net 45
23,044 adzuna.co.uk .uk 51
23,084 app.com .com 69
23,236 atrungroi.com .com 95
23,237 bet261.mg .mg 45
23,258 vi-hentai.pro .pro 57
23,379 chotot.com .com 83
23,589 resultadodelaloteria.com .com 89
23,613 nordbayern.de .de 81
23,957 essential.gg .gg 73
23,964 pcwelt.de .de 78
24,014 askmen.com .com 47
24,022 twinkl.co.uk .uk 37
24,102 knoxnews.com .com 74
24,190 jacksonville.com .com 74
24,468 flashscore.de .de 71
24,525 zin.ru .ru 41
24,710 tricolor.ru .ru 65
24,754 aol.co.uk .uk 66
24,787 waikato.ac.nz .nz 89
24,842 sdstate.edu .edu 74
24,882 uol.com .com 82
24,934 svtplay.se .se 78
24,983 sn.at .at 70
25,031 franceculture.fr .fr 81
25,048 tokyo-np.co.jp .jp 81
25,133 myrecipes.com .com 77
25,184 kompasiana.com .com 85
25,237 flashscorekz.com .com 70
25,451 omaha.com .com 80
25,478 franceinter.fr .fr 80
25,564 theadvocate.com .com 71
25,587 sfexaminer.com .com 69
25,653 livesport.com .com 69
25,677 flashscore.in .in 70
25,776 zinio.com .com 76
25,839 delawareonline.com .com 74
25,903 heraldtribune.com .com 73
25,911 arkansasonline.com .com 71
26,005 people.inc .inc 64
26,114 democratandchronicle.com .com 73
26,240 yogajournal.com .com 77
26,284 daytondailynews.com .com 67
26,342 straightdope.com .com 76
26,379 brisbanetimes.com.au .au 75
26,411 lanit.ru .ru 69
26,474 mbta.com .com 64
26,637 brigitte.de .de 79
26,842 unherd.com .com 83
26,853 tallahassee.com .com 74
26,949 vocus.cc .cc 78
26,963 premiumoutlets.com .com 31
26,970 airbnb.de .de 57
27,126 domserver.de .de 81
27,256 amny.com .com 83
27,344 ga.de .de 80
27,361 westfalen-blatt.de .de 81
27,406 warbyparker.com .com 76
27,422 affinity.co .co 95
27,467 wfmz.com .com 81
27,482 tug.org .org 44
27,696 staradvertiser.com .com 84
27,723 geek.com .com 38
27,756 beatstars.net .net 51
27,833 apotheken-umschau.de .de 45
27,838 mtvuutiset.fi .fi 72
27,891 blogto.com .com 67
27,946 trustedshops.de .de 73
28,021 sr.ht .ht 55
28,022 direct-book.com .com 45
28,149 dotmed.com .com 72
28,170 suedkurier.de .de 81
28,324 eurekamag.com .com 88
28,328 ipshu.com .com 82
28,383 lightreading.com .com 81
28,616 amzn.com .com 40
28,626 openfoodfacts.org .org 59
28,642 nachrichten.at .at 82
28,678 thenational.scot .scot 81
28,757 federalnewsnetwork.com .com 86
28,792 uesp.net .net 55
28,849 unitel.bo .bo 75
28,930 championcross.jp .jp 62
28,942 bttn.io .io 83
29,011 fraserinstitute.org .org 51
29,045 tt.com .com 75
29,115 gp.se .se 78
29,139 u-cursos.cl .cl 51
29,293 ceu.edu .edu 58
29,390 kompas.id .id 64
29,402 mmafighting.com .com 68
29,553 hankookilbo.com .com 84
29,572 flashscore.com.mx .mx 70
29,692 piliapp.com .com 65
29,787 blogmura.com .com 77
29,821 providencejournal.com .com 73
29,887 insanejournal.com .com 51
29,980 lidovky.cz .cz 67
30,004 sfstandard.com .com 72
30,196 youngchampion.jp .jp 62
30,237 clarionledger.com .com 74
30,298 afnor.org .org 81
30,305 telnyx.com .com 94
30,356 edaily.co.kr .kr 74
30,387 bsc.es .es 37
30,399 spoton.com .com 94
30,443 dobrzemieszkaj.pl .pl 61
30,507 abc11.com .com 81
30,556 traum-ferienwohnungen.de .de 71
30,703 wickedlocal.com .com 75
30,810 kentonline.co.uk .uk 76
30,828 bowdoin.edu .edu 71
30,974 techadvisor.com .com 85
30,986 commercialappeal.com .com 74
30,992 huffingtonpost.it .it 83
31,003 maxim.com .com 87
31,032 howlongtobeat.com .com 49
31,176 edp24.co.uk .uk 79
31,252 forumactif.com .com 83
31,282 vndb.org .org 60
31,320 lumendatabase.org .org 51
31,443 saarbruecker-zeitung.de .de 82
31,499 bolasport.com .com 76
31,549 lohud.com .com 74
31,782 mastodon.online .online 49
31,786 thespec.com .com 64
31,850 avsforum.com .com 43
31,857 weawow.com .com 65
32,125 elmercurio.com .com 43
32,169 journaldugeek.com .com 91
32,267 theargus.co.uk .uk 79
32,279 custommapposter.com .com 77
32,388 rgj.com .com 73
32,437 hoopshype.com .com 70
32,516 newworldencyclopedia.org .org 80
32,617 flo.com.tr .tr 52
32,713 opovo.com.br .br 85
32,718 athletic.net .net 68
32,803 oxfordmail.co.uk .uk 79
33,054 biologicaldiversity.org .org 66
33,312 airbnb.es .es 59
33,348 calacademy.org .org 75
33,349 qq8893.com .com 68
33,482 airbnb.it .it 58
33,494 theanalyst.com .com 88
33,562 myporntube.com .com 86
33,654 liegagego33.com .com 49
33,738 ruv.is .is 59
33,793 observer.co.uk .uk 74
33,931 lancasteronline.com .com 79
33,971 airbnb.com.au .au 58
34,113 kentek.ru .ru 83
34,185 atpress.ne.jp .jp 91
34,309 unionleader.com .com 63
34,350 juju.com .com 72
34,387 breakingnews.ie .ie 71
34,412 amzlink.to .to 69
34,445 monoskop.org .org 43
34,491 sfweekly.com .com 74
34,589 shabdkosh.com .com 83
34,718 sportsyou.com .com 86
34,750 mailplus.co.uk .uk 44
34,961 volksfreund.de .de 83
34,973 naplesnews.com .com 73
34,974 topagrar.com .com 85
34,983 wbez.org .org 78
34,986 ruhrnachrichten.de .de 75
35,000 local.ch .ch 65
35,058 gaoding.com .com 62
35,322 tk999vip.com .com 51
35,324 northdata.de .de 81
35,364 road.cc .cc 84
35,404 mapadeapellidos.com .com 75
35,517 datacenterknowledge.com .com 82
35,543 news-journalonline.com .com 73
35,684 americanrhetoric.com .com 45
35,760 montgomerycountymd.gov .gov 65
35,800 wn.de .de 80
35,803 housepricesintheuk.co.uk .uk 74
35,828 dotdashmeredith.com .com 64
35,933 hrs.com .com 82
35,953 redflagdeals.com .com 44
36,334 ytmnd.com .com 41
36,434 businessday.co.za .za 82
36,436 liquor.com .com 77
36,539 nd-aktuell.de .de 78
36,575 dailyecho.co.uk .uk 81
36,702 299betvip.com .com 51
36,803 tennis.com .com 59
PreviousPage 3 of 5Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the ImagesiftBot reference, the full census, and the JSON endpoint.