Blocklist · ByteDance

Sites that block TikTokSpider

247 of the 29,991 domains we have measured, 0.8%, disallow tiktokspider at the site root in robots.txt. TikTokSpider fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from ByteDance's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

ByteDance documents that this agent may ignore robots.txt, so a Disallow here records the site's stated preference rather than an enforced block.
The measurement

247 of 29,991 measured domains (0.8%) disallow tiktokspider at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block TikTokSpider", measured 2026-11-21. https://crawlcensus.com/blocked/tiktokspider

The list 247 domains

RankDomainTLDAI access score
42,305 nemphosbraue.com .com 93
42,614 citizen-times.com .com 74
43,302 seacoastonline.com .com 69
43,983 teambelgium.net .net 59
44,026 gainesville.com .com 66
44,183 barcablaugranes.com .com 68
44,228 notionpress.com .com 64
44,252 braunschweiger-zeitung.de .de 65
44,255 cagesideseats.com .com 72
44,807 gofeminin.de .de 74
44,874 news-leader.com .com 62
44,968 savannahnow.com .com 64
45,159 lansingstatejournal.com .com 62
45,316 eumetsat.int .int 80
45,349 wp.de .de 65
45,440 nrz.de .de 80
45,604 beaconjournal.com .com 66
45,680 greenvilleonline.com .com 62
46,033 waptrick.com .com 65
46,127 penn.museum .museum 81
46,231 registerguard.com .com 66
46,342 pjstar.com .com 66
46,360 pnj.com .com 62
46,635 wikihow.life .life 76
46,923 alisweb.org .org 39
46,949 schulferien.org .org 51
47,526 allgaeuer-zeitung.de .de 81
47,796 topekalibraries.info .info 46
47,884 vcstar.com .com 62
48,074 grubstreet.com .com 81
48,550 argusleader.com .com 62
48,858 otz.de .de 65
48,859 castro.fm .fm 67
49,194 mailonsunday.co.uk .uk 61
49,271 eltern.de .de 72
49,420 gds.it .it 77
49,501 sj-r.com .com 64
49,574 montgomeryadvertiser.com .com 62
49,695 pricesmart.com .com 61
49,713 retail.ru .ru 89
50,085 selectra.info .info 90
50,278 burlingtonfreepress.com .com 62
50,367 blipfoto.com .com 57
50,426 bolshoyvopros.ru .ru 70
50,682 commonsense.org .org 86
50,933 nwaonline.com .com 73
50,960 hot.com .com 67
PreviousPage 2 of 2

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the TikTokSpider reference, the full census, and the JSON endpoint.