Blocklist · Microsoft

Sites that block Bingbot

35 of the 29,991 domains we have measured, 0.1%, disallow bingbot at the site root in robots.txt. Bingbot builds the index that decides whether the operator's assistant cites a page.

Every domain here has removed itself from Microsoft's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

35 of 29,991 measured domains (0.1%) disallow bingbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block Bingbot", measured 2026-11-22. https://crawlcensus.com/blocked/bingbot

The list 35 domains

RankDomainTLDAI access score
1,754 ad-contents.jp .jp 45
1,789 1c.ru .ru 79
3,872 cia.gov .gov 49
4,024 aif.ru .ru 73
8,581 readli.net .net 76
9,677 aagag.com .com 47
10,024 nukistream.com .com 67
15,233 thieme-connect.com .com 39
16,122 page-stats.de .de 49
18,653 roland.com .com 71
21,081 netvasco.com.br .br 67
21,162 psytests.org .org 69
21,571 privatter.net .net 59
22,211 masutabe.info .info 75
23,458 inveragil.com .com 34
23,490 rossko.ru .ru 67
24,852 ascii.jp .jp 71
25,826 cnnic.cn .cn 58
27,737 texasattorneygeneral.gov .gov 65
28,942 bttn.io .io 83
29,121 pucsp.br .br 55
29,701 thieme-connect.de .de 79
30,393 ecode360.com .com 44
31,796 winespectator.com .com 82
34,412 amzlink.to .to 69
35,443 thisdaylive.com .com 72
37,261 petsathome.com .com 90
37,928 farrow-ball.com .com 75
38,712 simplebooking.it .it 74
40,040 timeedit.net .net 53
40,282 onelaunch.com .com 90
40,931 productreview.com.au .au 81
48,109 thegef.org .org 73
49,136 tubeorigin.com .com 69
50,003 europeanfilmgateway.eu .eu 65

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the Bingbot reference, the full census, and the JSON endpoint.