Blocklist · Mistral AI

Sites that block MistralAI-User

457 of the 29,991 domains we have measured, 2%, disallow mistralai-user at the site root in robots.txt. MistralAI-User fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from Mistral AI's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

457 of 29,991 measured domains (2%) disallow mistralai-user at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block MistralAI-User", measured 2026-11-21. https://crawlcensus.com/blocked/mistralai-user

The list 457 domains

RankDomainTLDAI access score
26 amazon.com .com 40
54 tiktok.com .com 49
62 msn.com .com 41
121 amazonvideo.com .com 55
190 cnn.com .com 50
318 amazon.co.uk .uk 40
377 amazon.de .de 40
494 amazon.co.jp .jp 40
533 wired.com .com 81
571 uol.com.br .br 82
609 amazon.fr .fr 40
623 amazon.co.za .za 40
627 dailymail.co.uk .uk 61
635 amazon.ca .ca 40
659 amazon.in .in 40
662 cnet.com .com 79
671 lemonde.fr .fr 81
681 dailymail.com .com 61
682 primevideo.com .com 71
706 amazon.it .it 40
725 amazon.es .es 40
763 bild.de .de 81
812 amazon.com.au .au 40
815 theverge.com .com 77
823 nbcnews.com .com 59
833 amazon.com.br .br 40
834 lefigaro.fr .fr 71
955 corriere.it .it 63
983 elmundo.es .es 84
1,019 theconversation.com .com 62
1,032 amazon.com.mx .mx 40
1,042 spiegel.de .de 64
1,056 marca.com .com 85
1,061 as.com .com 84
1,073 bfmtv.com .com 81
1,098 franceinfo.fr .fr 60
1,223 furaffinity.net .net 39
1,286 actu.fr .fr 81
1,376 dagbladet.no .no 74
1,394 usnews.com .com 83
1,409 iltalehti.fi .fi 58
1,456 eenadu.net .net 67
1,639 darkero.com .com 67
1,793 newyorker.com .com 73
1,831 zdnet.com .com 76
1,835 wikihow.com .com 76
1,984 themoviedb.org .org 74
1,993 ign.com .com 62
2,006 amazon.eg .eg 40
2,010 mashable.com .com 61
2,084 justice.gov .gov 54
2,215 techradar.com .com 87
2,325 nrk.no .no 69
2,348 nontondrama.my .my 77
2,423 pcmag.com .com 63
2,585 livescience.com .com 85
2,691 newscientist.com .com 76
2,786 chicagotribune.com .com 79
2,899 vanityfair.it .it 77
2,917 faz.net .net 39
2,969 today.com .com 62
2,989 vogue.com .com 82
3,198 metro.co.uk .uk 59
3,286 flipboard.com .com 64
3,331 tomshardware.com .com 87
3,342 lifehacker.com .com 65
3,368 nzherald.co.nz .nz 56
3,371 nymag.com .com 74
3,499 amazon.se .se 40
3,520 amazon.ae .ae 40
3,533 vanityfair.com .com 81
3,576 abc.es .es 81
3,595 politico.eu .eu 62
3,598 amazon.nl .nl 40
3,676 handelsblatt.com .com 82
3,873 space.com .com 85
4,161 kompas.com .com 77
4,512 amazon.com.tr .tr 40
4,553 20minutes.fr .fr 71
4,925 cadenaser.com .com 78
4,987 dr.dk .dk 81
5,026 pcgamer.com .com 85
5,068 gq.com .com 81
5,146 everydayhealth.com .com 60
5,158 mercurynews.com .com 78
5,401 mediamarkt.de .de 90
5,413 expressen.se .se 61
5,457 diigo.com .com 35
5,523 architecturaldigest.com .com 83
5,547 amazon.ie .ie 40
5,678 dn.se .se 60
5,681 nationalpost.com .com 71
5,714 francetvinfo.fr .fr 53
5,874 hs.fi .fi 68
6,089 azcentral.com .com 74
6,125 denverpost.com .com 78
6,180 tf1info.fr .fr 84
6,228 sbnation.com .com 69
6,246 eurogamer.net .net 57
6,288 vulture.com .com 72
6,352 tv2.dk .dk 74
6,356 freep.com .com 73
6,361 ici.fr .fr 87
6,377 gamesradar.com .com 85
6,512 telegram.com .com 73
6,513 sandiegouniontribune.com .com 78
6,522 eater.com .com 59
6,593 wired.co.uk .uk 64
6,609 procyclingstats.com .com 56
6,610 is.fi .fi 68
6,816 maxroll.gg .gg 59
6,822 elcorreo.com .com 80
6,895 togetter.com .com 73
6,948 nicematin.com .com 77
7,042 cntraveler.com .com 82
7,106 nrc.nl .nl 84
7,127 hani.co.kr .kr 67
7,239 gala.de .de 76
7,268 nzz.ch .ch 76
7,275 baltimoresun.com .com 76
7,455 amazon.sg .sg 40
7,562 nettavisen.no .no 63
7,738 pitchfork.com .com 81
7,856 popsugar.com .com 75
7,863 refinery29.com .com 78
7,981 afr.com .com 72
8,030 oceanofpdf.com .com 59
8,435 thecut.com .com 84
8,449 sextb.net .net 62
8,606 javdb.com .com 52
8,789 supremevalues.com .com 70
8,866 theweek.com .com 84
8,959 glamour.com .com 81
9,062 bluewin.ch .ch 66
9,069 wbur.org .org 81
9,339 detroitnews.com .com 68
9,388 law.com .com 68
9,542 findnovel.net .net 64
10,074 cope.es .es 86
10,291 usmagazine.com .com 87
10,335 windowscentral.com .com 85
10,345 inews.co.uk .uk 67
10,432 expansion.com .com 81
10,470 babycenter.com .com 62
10,495 financialpost.com .com 71
10,501 ocregister.com .com 80
10,552 self.com .com 68
10,708 vogue.co.uk .uk 79
10,826 bonappetit.com .com 82
10,885 livestrong.com .com 80
10,894 augsburger-allgemeine.de .de 81
11,107 bibliocommons.com .com 85
11,130 lexpress.fr .fr 86
11,217 businessinsider.de .de 76
11,242 teenvogue.com .com 82
11,610 allure.com .com 84
12,058 wiwo.de .de 82
12,113 bostonherald.com .com 78
12,441 novelfire.net .net 64
12,533 indystar.com .com 73
12,542 epicurious.com .com 64
12,550 kiplinger.com .com 85
12,743 extremetech.com .com 64
12,799 curbed.com .com 73
13,237 clicrbs.com.br .br 80
13,355 marieclaire.com .com 85
13,398 gq-magazine.co.uk .uk 81
13,419 vancouversun.com .com 71
13,579 barcelona.cat .cat 82
13,617 latribune.fr .fr 72
13,660 thrillist.com .com 70
13,667 dispatch.com .com 74
13,668 torontosun.com .com 71
13,783 creativebloq.com .com 87
13,825 heraldscotland.com .com 81
13,860 francebleu.fr .fr 87
13,871 ilex.by .by 59
13,873 rappler.com .com 80
13,879 tennessean.com .com 74
14,053 androidcentral.com .com 83
14,090 simon.com .com 31
14,809 auto-motor-und-sport.de .de 81
14,826 rockpapershotgun.com .com 58
14,862 canada.com .com 71
14,873 rareanimes.mov .mov 72
15,174 pcgamesn.com .com 83
15,269 gamesindustry.biz .biz 57
15,401 desmoinesregister.com .com 74
15,476 computerbild.de .de 81
15,509 diariovasco.com .com 82
15,557 cincinnati.com .com 74
16,103 dweb.link .link 65
16,134 homesandgardens.com .com 84
16,209 ipfs.io .io 65
16,254 unil.ch .ch 83
16,256 runnerspace.com .com 47
16,564 mapgenie.io .io 59
16,664 lightningmaps.org .org 51
16,814 whattoexpect.com .com 65
17,042 northjersey.com .com 74
Page 1 of 3Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the MistralAI-User reference, the full census, and the JSON endpoint.