AI crawler · registry

MistralAI-Index

Mistral AI · Answer index · robots.txt token mistralai-index

honors robots.txtMeasured across 3,958 sites with a robots.txt policy record for this agent, out of 7,068 on record.
0.4%
of measured sites block it
16
sites blocking
3,942
sites allowing
yes
honors robots.txt

What it is definition

Indexes content for Mistral search behind Vibe answers; not used for generative AI training.

MistralAI-Index is operated by Mistral AI and classified here as answer index. These agents build the index an answer engine queries at question time. Disallowing one removes the site from those answers and from the citations that link back to it. Training is governed by separate tokens, so this is the expensive block, not the protective one.

Disallowing mistralai-index removes the site from the index Mistral AI's AI products queries when it answers a question. The engine can then neither quote nor link the page, which is a traffic decision rather than a licensing one. Model training is governed by separate tokens.

robots.txt token
mistralai-index
Operator
Mistral AI
Purpose
Answer index
Honors robots.txt
yes
Documentation
https://docs.mistral.ai/robots/

Identity on the wire exact string

User-agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Index/1.0; +https://docs.mistral.ai/robots)
Verify your own edge is not refusing it
curl -A 'Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Index/1.0; +https://docs.mistral.ai/robots)' https://example.com/

Replace the host with your own. A 403, a challenge page or an empty body means the edge is blocking the agent whatever robots.txt says.

How to allow it, how to block it robots.txt

Allow it
User-agent: mistralai-index
Allow: /

Absent any rule, the agent is already allowed, so this group only matters when your * group disallows something. Naming the agent replaces the * group for it entirely, so repeat here every disallow you still want to apply to it.

Block it
User-agent: mistralai-index
Disallow: /

Disallowing mistralai-index removes the site from the index Mistral AI's AI products queries when it answers a question. The engine can then neither quote nor link the page, which is a traffic decision rather than a licensing one. Model training is governed by separate tokens.

Sites that block it 38 shown

DomainAI access scoreRank
msn.com 34 62
lemonde.fr 72 671
people.com 38 801
investopedia.com 38 913
actu.fr 76 1,286
techradar.com 83 2,215
livescience.com 81 2,585
allrecipes.com 38 3,184
flipboard.com 68 3,286
tomshardware.com 83 3,331
space.com 79 3,873
thestar.com 65 4,107
verywellhealth.com 38 4,285
verywellmind.com 38 4,344
southernliving.com 38 4,491
20minutes.fr 65 4,553
independent.ie 37 4,569
marthastewart.com 38 4,625
thespruce.com 38 4,644
eatingwell.com 38 4,747
tomsguide.com 78 4,787
telegraaf.nl 37 4,941
ew.com 38 4,983
pcgamer.com 81 5,026
travelandleisure.com 38 5,171
theepochtimes.com 71 5,684
seriouseats.com 38 5,686
thebalancemoney.com 38 5,708
thoughtco.com 38 6,008
gamesradar.com 79 6,377
sandiegouniontribune.com 68 6,513
foodandwine.com 65 6,654
health.com 38 6,775
bhg.com 38 6,940
realsimple.com 38 7,023
treehugger.com 38 7,276
lifewire.com 38 7,823
theweek.com 78 8,866

Compare Mistral AI

Mistral AI runs 3 agents in this registry, and they do different jobs. Blocking one says nothing about the others.

Common questions answered

Does blocking MistralAI-Index remove me from Mistral AI's AI products?

Yes, in effect. MistralAI-Index builds the index Mistral AI's AI products reads at question time, so disallowing it takes the site out of those answers and out of the citations that link back to it. This is the block that costs traffic.

How do I verify MistralAI-Index requests are genuine?

Mistral AI publishes neither reverse DNS names nor address ranges for MistralAI-Index, so a request carrying this user agent cannot be authenticated. The string is trivially spoofed and is routinely reused by unrelated scrapers. Treat it as a hint, rate-limit by source address, and do not grant it access you would not grant an anonymous client.

Check your own site free

See whether your robots.txt admits MistralAI-Index today, and whether your edge agrees with it.