Blocklist · Meta

Sites that block facebookexternalhit

56 of the 29,991 domains we have measured, 0.2%, disallow facebookexternalhit at the site root in robots.txt. facebookexternalhit fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from Meta's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

Meta documents that this agent may ignore robots.txt, so a Disallow here records the site's stated preference rather than an enforced block.
The measurement

56 of 29,991 measured domains (0.2%) disallow facebookexternalhit at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block facebookexternalhit", measured 2026-11-21. https://crawlcensus.com/blocked/facebookexternalhit

The list 56 domains

RankDomainTLDAI access score
1,223 furaffinity.net .net 39
1,835 wikihow.com .com 76
2,917 faz.net .net 39
3,276 myanimelist.net .net 70
3,286 flipboard.com .com 64
3,595 politico.eu .eu 62
5,681 nationalpost.com .com 71
6,948 nicematin.com .com 77
7,863 refinery29.com .com 78
10,093 sgxnifty.org .org 91
10,495 financialpost.com .com 71
11,504 gamblingtherapy.org .org 87
13,419 vancouversun.com .com 71
13,668 torontosun.com .com 71
13,871 ilex.by .by 59
14,862 canada.com .com 71
15,233 thieme-connect.com .com 39
16,122 page-stats.de .de 49
16,664 lightningmaps.org .org 51
17,492 ina.fr .fr 76
18,306 locally.com .com 88
19,941 ottawacitizen.com .com 71
20,318 supersport.hr .hr 51
21,685 calgaryherald.com .com 71
21,823 desy.de .de 62
24,525 zin.ru .ru 41
25,811 pecom.ru .ru 95
26,342 straightdope.com .com 76
27,737 texasattorneygeneral.gov .gov 65
29,139 u-cursos.cl .cl 51
29,224 ulife.com.br .br 54
29,639 edmontonjournal.com .com 71
29,701 thieme-connect.de .de 79
30,387 bsc.es .es 37
31,282 vndb.org .org 60
31,768 ticketspice.com .com 92
34,581 zumper.com .com 78
36,237 saltwire.com .com 70
36,334 ytmnd.com .com 41
36,372 eurobilltracker.com .com 65
38,409 igt.com .com 48
40,628 regfox.com .com 81
41,232 chipsmall.com .com 82
41,542 oefb.at .at 50
42,076 iex.nl .nl 48
42,862 horseracingnation.com .com 72
43,909 gipuzkoa.eus .eus 70
43,983 teambelgium.net .net 59
44,299 theprovince.com .com 71
45,390 tupalo.com .com 57
46,635 wikihow.life .life 76
46,671 edurev.in .in 89
46,923 alisweb.org .org 39
47,796 topekalibraries.info .info 46
49,611 gamedesire.com .com 85
50,003 europeanfilmgateway.eu .eu 65

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the facebookexternalhit reference, the full census, and the JSON endpoint.