Blocklist · ByteDance

Sites that block TikTokSpider

244 of the 30,152 domains we have measured, 0.8%, disallow tiktokspider at the site root in robots.txt. TikTokSpider fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from ByteDance's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

ByteDance documents that this agent may ignore robots.txt, so a Disallow here records the site's stated preference rather than an enforced block.
The measurement

244 of 30,152 measured domains (0.8%) disallow tiktokspider at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-08-24 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block TikTokSpider", measured 2026-08-24. https://crawlcensus.com/blocked/tiktokspider

The list 244 domains

RankDomainTLDAI access score
42,293 tfd.com .com 69
43,983 teambelgium.net .net 59
44,183 barcablaugranes.com .com 68
44,228 notionpress.com .com 69
44,252 braunschweiger-zeitung.de .de 65
44,255 cagesideseats.com .com 67
44,807 gofeminin.de .de 80
45,316 eumetsat.int .int 80
45,349 wp.de .de 65
45,378 essen-und-trinken.de .de 75
45,440 nrz.de .de 63
46,033 waptrick.com .com 66
46,127 penn.museum .museum 81
46,231 registerguard.com .com 66
46,342 pjstar.com .com 66
46,360 pnj.com .com 62
46,635 wikihow.life .life 76
46,876 cccb.org .org 52
46,923 alisweb.org .org 31
46,939 southwalesargus.co.uk .uk 69
46,949 schulferien.org .org 59
47,166 tu.berlin .berlin 64
47,228 newsandstar.co.uk .uk 71
47,526 allgaeuer-zeitung.de .de 73
47,796 topekalibraries.info .info 38
47,884 vcstar.com .com 62
48,074 grubstreet.com .com 73
48,550 argusleader.com .com 62
48,858 otz.de .de 65
48,859 castro.fm .fm 67
49,194 mailonsunday.co.uk .uk 57
49,271 eltern.de .de 74
49,420 gds.it .it 77
49,501 sj-r.com .com 64
49,574 montgomeryadvertiser.com .com 62
49,713 retail.ru .ru 89
49,986 echo-news.co.uk .uk 71
50,085 selectra.info .info 90
50,267 worcesternews.co.uk .uk 71
50,278 burlingtonfreepress.com .com 74
50,367 blipfoto.com .com 57
50,426 bolshoyvopros.ru .ru 70
50,499 themanual.com .com 84
50,933 nwaonline.com .com 57
PreviousPage 2 of 2

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the TikTokSpider reference, the full census, and the JSON endpoint.