Blocklist · Meta

Sites that block FacebookBot

919 of the 29,991 domains we have measured, 3%, disallow facebookbot at the site root in robots.txt. FacebookBot collects content that may be used to train a model.

Every domain here has withheld its content from Meta's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

919 of 29,991 measured domains (3%) disallow facebookbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block FacebookBot", measured 2026-11-22. https://crawlcensus.com/blocked/facebookbot

The list 919 domains

RankDomainTLDAI access score
17,183 semafor.com .com 72
17,255 thegamer.com .com 83
17,266 letemps.ch .ch 74
17,432 kyoto-np.co.jp .jp 82
17,455 twincities.com .com 81
17,469 palmbeachpost.com .com 73
17,483 diariodenavarra.es .es 89
17,489 dukeupress.edu .edu 73
17,492 ina.fr .fr 76
17,522 daangn.com .com 71
17,554 abc13.com .com 79
17,619 nst.com.my .my 42
17,694 manager-magazin.de .de 63
17,750 6abc.com .com 79
17,886 agrarheute.com .com 75
17,983 brightlocal.com .com 90
17,988 timeslive.co.za .za 80
18,071 flashscore.co.uk .uk 71
18,147 volksstimme.de .de 68
18,153 vlex.com .com 88
18,308 preyproject.com .com 93
18,311 earthsky.org .org 85
18,338 telemundo.com .com 83
18,373 instyle.de .de 89
18,388 freemusicarchive.org .org 65
18,402 xueqiu.com .com 47
18,522 thenews.com.pk .pk 65
18,549 gamasutra.com .com 83
18,687 romatoday.it .it 67
18,782 pepper.pl .pl 76
18,812 nbcphiladelphia.com .com 62
18,822 nbcdfw.com .com 33
18,863 dailynews.com .com 76
18,867 adressa.no .no 66
18,870 scotusblog.com .com 83
18,883 courier-journal.com .com 74
18,894 courrierinternational.com .com 83
18,978 dexerto.com .com 78
19,181 comparitech.com .com 88
19,283 denik.cz .cz 77
19,298 nbcmiami.com .com 60
19,314 milanotoday.it .it 67
19,411 clien.net .net 79
19,429 thenewstack.io .io 69
19,624 fukuishimbun.co.jp .jp 76
19,632 coolrom.com .com 61
19,636 euobserver.com .com 86
19,690 equidia.fr .fr 65
19,696 givemesport.com .com 83
19,860 zawya.com .com 80
20,081 flashscore.com.tr .tr 70
20,232 uv.mx .mx 75
20,318 supersport.hr .hr 51
20,362 thedodo.com .com 70
20,481 flashscore.pt .pt 72
20,556 bravotv.com .com 74
20,575 artnews.com .com 80
20,845 wnd.com .com 90
20,858 flashscore.vn .vn 72
20,865 espn.com.co .co 48
20,871 lavenir.net .net 83
20,958 pressdemocrat.com .com 80
21,004 femina.hu .hu 82
21,030 rugbyrama.fr .fr 89
21,038 mainpost.de .de 80
21,139 ledevoir.com .com 70
21,155 grupostelegram.net .net 54
21,231 epochtimes.com .com 85
21,267 seher.no .no 70
21,553 azfamily.com .com 78
21,568 cvbankas.lt .lt 74
21,586 madison.com .com 80
21,707 khronos.org .org 68
21,736 slate.fr .fr 68
21,823 desy.de .de 62
21,889 scoop.co.nz .nz 67
21,890 telerama.fr .fr 83
21,983 mypcards.com .com 76
21,999 dailyhive.com .com 74
22,007 vg247.com .com 58
22,016 canva.in .in 86
22,365 petitesannonces.ch .ch 67
22,476 gruposwats.com .com 54
22,596 flashscore.gr .gr 72
22,623 mcall.com .com 78
22,840 nbcsandiego.com .com 64
22,938 congobet.net .net 45
23,044 adzuna.co.uk .uk 51
23,084 app.com .com 69
23,154 rbb24.de .de 80
23,237 bet261.mg .mg 45
23,288 catbox.moe .moe 59
23,378 winnipegfreepress.com .com 78
23,379 chotot.com .com 83
23,940 pirateswap.com .com 78
23,964 pcwelt.de .de 78
24,000 icecat.biz .biz 44
24,014 askmen.com .com 47
24,102 knoxnews.com .com 74
24,112 foxsports.com.au .au 75
24,190 jacksonville.com .com 74
24,468 flashscore.de .de 71
24,520 nbcboston.com .com 33
24,525 zin.ru .ru 41
24,567 newspicks.com .com 44
24,710 tricolor.ru .ru 65
24,733 humanite.fr .fr 87
24,754 aol.co.uk .uk 66
24,882 uol.com .com 82
24,934 svtplay.se .se 78
25,031 franceculture.fr .fr 81
25,048 tokyo-np.co.jp .jp 81
25,115 pilotonline.com .com 79
25,133 myrecipes.com .com 77
25,184 kompasiana.com .com 85
25,237 flashscorekz.com .com 70
25,239 greatist.com .com 80
25,382 lbc.co.uk .uk 86
25,391 americastestkitchen.com .com 80
25,451 omaha.com .com 80
25,453 research.com .com 70
25,478 franceinter.fr .fr 80
25,564 theadvocate.com .com 71
25,566 irishnews.com .com 68
25,587 sfexaminer.com .com 69
25,597 matchendirect.fr .fr 86
25,653 livesport.com .com 69
25,677 flashscore.in .in 70
25,678 consequence.net .net 85
25,776 zinio.com .com 76
25,839 delawareonline.com .com 74
25,903 heraldtribune.com .com 73
25,911 arkansasonline.com .com 71
26,005 people.inc .inc 64
26,114 democratandchronicle.com .com 73
26,210 kstp.com .com 83
26,240 yogajournal.com .com 77
26,284 daytondailynews.com .com 67
26,342 straightdope.com .com 76
26,379 brisbanetimes.com.au .au 75
26,411 lanit.ru .ru 69
26,444 pap.pl .pl 39
26,474 mbta.com .com 64
26,636 northropgrumman.com .com 83
26,637 brigitte.de .de 79
26,751 eluniverso.com .com 76
26,806 golf.com .com 88
26,842 unherd.com .com 83
26,843 additudemag.com .com 93
26,853 tallahassee.com .com 74
26,935 fd.nl .nl 73
26,949 vocus.cc .cc 78
27,078 mdzol.com .com 61
27,126 domserver.de .de 81
27,214 backloggd.com .com 70
27,256 amny.com .com 83
27,306 stylecaster.com .com 77
27,344 ga.de .de 80
27,361 westfalen-blatt.de .de 81
27,401 derstandard.de .de 56
27,425 carbuzz.com .com 85
27,467 wfmz.com .com 81
27,482 tug.org .org 44
27,696 staradvertiser.com .com 84
27,723 geek.com .com 38
27,833 apotheken-umschau.de .de 45
27,891 blogto.com .com 67
28,022 direct-book.com .com 45
28,038 topspeed.com .com 81
28,170 suedkurier.de .de 81
28,220 icecat.se .se 52
28,237 zamin.uz .uz 92
28,290 icecat.dk .dk 56
28,324 eurekamag.com .com 88
28,383 lightreading.com .com 81
28,573 wpr.org .org 88
28,642 nachrichten.at .at 82
28,757 federalnewsnetwork.com .com 86
28,792 uesp.net .net 55
28,794 eastbaytimes.com .com 79
28,930 championcross.jp .jp 62
29,001 completesports.com .com 88
29,139 u-cursos.cl .cl 51
29,402 mmafighting.com .com 68
29,499 conjur.com.br .br 73
29,553 hankookilbo.com .com 84
29,572 flashscore.com.mx .mx 70
29,692 piliapp.com .com 65
29,821 providencejournal.com .com 73
29,884 techtudo.com.br .br 84
29,946 lareviewofbooks.org .org 57
29,980 lidovky.cz .cz 67
30,004 sfstandard.com .com 72
30,074 yugipedia.com .com 58
30,196 youngchampion.jp .jp 62
30,237 clarionledger.com .com 74
30,298 afnor.org .org 81
30,387 bsc.es .es 37
30,443 dobrzemieszkaj.pl .pl 61
30,500 routard.com .com 78
PreviousPage 3 of 5Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the FacebookBot reference, the full census, and the JSON endpoint.