Blocklist · Mistral AI

Sites that block MistralAI-User

457 of the 29,991 domains we have measured, 2%, disallow mistralai-user at the site root in robots.txt. MistralAI-User fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from Mistral AI's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

457 of 29,991 measured domains (2%) disallow mistralai-user at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block MistralAI-User", measured 2026-11-21. https://crawlcensus.com/blocked/mistralai-user

The list 457 domains

RankDomainTLDAI access score
17,183 semafor.com .com 72
17,420 jsbin.com .com 53
17,455 twincities.com .com 81
17,469 palmbeachpost.com .com 73
17,492 ina.fr .fr 76
17,694 manager-magazin.de .de 63
17,833 novelphoenix.com .com 61
17,886 agrarheute.com .com 75
17,936 cinemablend.com .com 87
18,280 hoerzu.de .de 45
18,309 mans.io .io 60
18,442 empireonline.com .com 62
18,522 thenews.com.pk .pk 65
18,595 trycloudflare.com .com 52
18,799 ironman.com .com 75
18,863 dailynews.com .com 76
18,883 courier-journal.com .com 74
19,312 pinayflix.uk .uk 46
19,631 spectrumlocalnews.com .com 45
19,762 desixxx.blog .blog 65
19,860 zawya.com .com 80
19,891 musicradar.com .com 87
19,941 ottawacitizen.com .com 71
20,362 thedodo.com .com 70
20,364 derwesten.de .de 83
20,718 itpro.com .com 83
20,847 gardeningknowhow.com .com 83
20,958 pressdemocrat.com .com 80
21,004 femina.hu .hu 82
21,038 mainpost.de .de 80
21,267 seher.no .no 70
21,481 futureplc.com .com 86
21,566 whowhatwear.com .com 82
21,685 calgaryherald.com .com 71
21,809 cyclingnews.com .com 85
21,823 desy.de .de 62
21,828 wallpaper.com .com 85
22,007 vg247.com .com 58
22,623 mcall.com .com 78
23,084 app.com .com 69
23,157 mlnba.fun .fun 54
23,298 fuegodevida.com .com 58
23,875 imore.com .com 81
24,014 askmen.com .com 47
24,102 knoxnews.com .com 74
24,141 cntraveller.com .com 81
24,157 whathifi.com .com 87
24,190 jacksonville.com .com 74
24,233 glamourmagazine.co.uk .uk 81
24,525 zin.ru .ru 41
24,593 vogue.in .in 64
24,853 nameswriter.com .com 48
24,882 uol.com .com 82
24,892 eldiariomontanes.es .es 82
24,946 vogue.fr .fr 81
24,961 miaminewtimes.com .com 73
24,977 wired.it .it 83
25,007 digitalcameraworld.com .com 86
25,031 franceculture.fr .fr 81
25,065 ny1.com .com 68
25,115 pilotonline.com .com 79
25,133 myrecipes.com .com 77
25,478 franceinter.fr .fr 80
25,839 delawareonline.com .com 74
25,903 heraldtribune.com .com 73
25,911 arkansasonline.com .com 71
26,114 democratandchronicle.com .com 73
26,249 guitarworld.com .com 84
26,444 pap.pl .pl 39
26,637 brigitte.de .de 79
26,853 tallahassee.com .com 74
26,935 fd.nl .nl 73
26,963 premiumoutlets.com .com 31
27,113 in3x.net .net 38
27,315 fourfourtwo.com .com 84
27,723 geek.com .com 38
27,796 asiasociety.org .org 67
27,838 mtvuutiset.fi .fi 72
28,170 suedkurier.de .de 81
28,320 laptopmag.com .com 87
28,377 menuweb.menu .menu 69
28,616 amzn.com .com 40
28,678 thenational.scot .scot 81
28,775 vogue.de .de 65
28,794 eastbaytimes.com .com 79
28,895 weatheronline.co.uk .uk 47
28,930 championcross.jp .jp 62
29,048 gq-magazin.de .de 66
29,139 u-cursos.cl .cl 51
29,341 geometrylitepc.io .io 70
29,390 kompas.id .id 64
29,402 mmafighting.com .com 68
29,477 hsex.icu .icu 63
29,634 westword.com .com 77
29,639 edmontonjournal.com .com 71
29,821 providencejournal.com .com 73
30,052 lasprovincias.es .es 82
30,074 yugipedia.com .com 58
30,196 youngchampion.jp .jp 62
30,237 clarionledger.com .com 74
30,619 spectrumnews1.com .com 45
30,703 wickedlocal.com .com 75
30,737 diariosur.es .es 82
30,986 commercialappeal.com .com 74
31,023 phoenixnewtimes.com .com 71
31,032 howlongtobeat.com .com 49
31,138 ideal.es .es 82
31,149 idealhome.co.uk .uk 82
31,176 edp24.co.uk .uk 79
31,282 vndb.org .org 60
31,320 lumendatabase.org .org 51
31,352 sportsbusinessjournal.com .com 53
31,499 bolasport.com .com 76
31,549 lohud.com .com 74
31,638 marieclaire.co.uk .uk 84
31,786 thespec.com .com 64
31,799 wefut.com .com 50
32,267 theargus.co.uk .uk 79
32,388 rgj.com .com 73
32,437 hoopshype.com .com 70
32,460 saturn.de .de 91
32,498 toptenreviews.com .com 87
32,579 dallasobserver.com .com 77
32,617 flo.com.tr .tr 52
32,631 baynews9.com .com 68
32,790 tatler.com .com 82
32,803 oxfordmail.co.uk .uk 79
32,806 tvnet.lv .lv 79
32,918 laverdad.es .es 82
33,254 aan.com .com 74
33,793 observer.co.uk .uk 74
33,915 b254.com .com 54
34,012 womanandhome.com .com 85
34,097 vogue.es .es 65
34,148 asianfanfics.com .com 58
34,236 welib.st .st 47
34,301 stevehoffman.tv .tv 65
34,309 unionleader.com .com 63
34,750 mailplus.co.uk .uk 44
34,847 sydsvenskan.se .se 52
34,973 naplesnews.com .com 73
34,986 ruhrnachrichten.de .de 75
35,062 dailypress.com .com 79
35,364 road.cc .cc 84
35,543 news-journalonline.com .com 73
35,759 houseandgarden.co.uk .uk 81
36,120 elcomercio.es .es 82
36,237 saltwire.com .com 70
36,334 ytmnd.com .com 41
36,356 elgaronline.com .com 45
36,436 liquor.com .com 77
36,575 dailyecho.co.uk .uk 81
36,646 cyclingweekly.com .com 85
36,778 cwmars.org .org 43
37,700 rutracker.net .net 43
37,821 golfmonthly.com .com 83
38,007 wired.jp .jp 78
38,129 11freunde.de .de 58
38,148 news-press.com .com 73
38,327 inforum.com .com 70
38,409 igt.com .com 48
38,507 bournemouthecho.co.uk .uk 79
38,668 stimme.de .de 72
38,814 mas.to .to 31
38,876 elnortedecastilla.es .es 82
39,206 futurezone.de .de 86
39,349 hoy.es .es 82
39,824 werstreamt.es .es 59
40,184 estantevirtual.com.br .br 91
40,328 bntu.by .by 80
40,339 kompas.tv .tv 76
40,512 thetelegraphandargus.co.uk .uk 78
40,638 main-echo.de .de 64
40,728 mediamarkt.pl .pl 89
40,796 elpasotimes.com .com 73
40,868 sayweee.com .com 72
40,874 grid.id .id 64
40,876 cntraveller.in .in 81
41,098 gqmagazine.fr .fr 82
41,121 lancashiretelegraph.co.uk .uk 78
41,290 theweek.co.uk .uk 84
41,603 lci.fr .fr 84
41,647 cjonline.com .com 73
41,736 eadt.co.uk .uk 79
41,760 dailybreeze.com .com 76
41,872 vanityfair.fr .fr 66
41,947 vogue.co.jp .jp 65
41,958 theledger.com .com 74
42,076 iex.nl .nl 48
42,113 glasgowtimes.co.uk .uk 79
42,160 tcpalm.com .com 73
42,582 decanter.com .com 85
42,614 citizen-times.com .com 74
42,698 sol.no .no 74
42,919 tcrf.net .net 29
43,207 tv4play.se .se 77
43,302 seacoastonline.com .com 69
43,587 admagazine.fr .fr 81
43,627 tvrain.ru .ru 84
43,974 ybw.com .com 87
PreviousPage 2 of 3Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the MistralAI-User reference, the full census, and the JSON endpoint.