Blocklist · DuckDuckGo

Sites that block DuckAssistBot

511 of the 29,748 domains we have measured, 2%, disallow duckassistbot at the site root in robots.txt. DuckAssistBot fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from DuckDuckGo's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

511 of 29,748 measured domains (2%) disallow duckassistbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-08-24 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block DuckAssistBot", measured 2026-08-24. https://crawlcensus.com/blocked/duckassistbot

The list 511 domains

RankDomainTLDAI access score
37,154 r777.net .net 51
37,367 mittelbayerische.de .de 82
38,007 wired.jp .jp 79
38,148 news-press.com .com 73
38,257 4players.de .de 83
38,327 inforum.com .com 70
38,409 igt.com .com 49
38,507 bournemouthecho.co.uk .uk 71
38,668 stimme.de .de 72
38,876 elnortedecastilla.es .es 84
38,945 postype.com .com 82
39,022 maville.com .com 42
39,206 futurezone.de .de 85
39,303 watoday.com.au .au 75
39,349 hoy.es .es 84
39,393 zakzak.co.jp .jp 72
39,824 werstreamt.es .es 52
40,317 iza.ne.jp .jp 79
40,328 bntu.by .by 77
40,339 kompas.tv .tv 81
40,512 thetelegraphandargus.co.uk .uk 69
40,638 main-echo.de .de 64
40,693 bonn.de .de 77
40,713 dwds.de .de 64
40,726 flashscoreusa.com .com 71
40,793 yorkpress.co.uk .uk 71
40,796 elpasotimes.com .com 73
40,874 grid.id .id 82
40,876 cntraveller.in .in 81
40,904 nesn.com .com 65
40,968 kontan.co.id .id 77
41,086 bnn.de .de 80
41,098 gqmagazine.fr .fr 75
41,121 lancashiretelegraph.co.uk .uk 69
41,336 archinect.com .com 44
41,368 gunbark.dev .dev 36
41,519 greenme.it .it 84
41,603 lci.fr .fr 84
41,647 cjonline.com .com 73
41,653 donaukurier.de .de 87
41,721 canarias7.es .es 82
41,736 eadt.co.uk .uk 71
41,760 dailybreeze.com .com 80
41,826 defcon.org .org 66
41,872 vanityfair.fr .fr 75
41,918 peopleenespanol.com .com 77
41,932 santacruzsentinel.com .com 78
41,947 vogue.co.jp .jp 79
41,958 theledger.com .com 74
42,076 iex.nl .nl 65
42,113 glasgowtimes.co.uk .uk 71
42,160 tcpalm.com .com 73
42,293 tfd.com .com 69
42,505 medietall.no .no 41
42,666 nhregister.com .com 54
43,132 jtbc.co.kr .kr 70
43,666 tasty.co .co 79
43,986 nn.de .de 81
44,138 gqindia.com .com 81
44,183 barcablaugranes.com .com 68
44,255 cagesideseats.com .com 67
44,714 marinij.com .com 79
44,807 gofeminin.de .de 80
44,878 rtvnoord.nl .nl 73
45,002 babycentre.co.uk .uk 63
45,240 vogue.mx .mx 74
45,272 rtvutrecht.nl .nl 73
45,316 eumetsat.int .int 80
45,378 essen-und-trinken.de .de 75
45,578 chugoku-np.co.jp .jp 80
45,771 larioja.com .com 85
45,846 amazon.jp .jp 40
45,918 revistagq.com .com 64
46,033 waptrick.com .com 66
46,168 bizapedia.com .com 52
46,231 registerguard.com .com 66
46,342 pjstar.com .com 66
46,360 pnj.com .com 62
46,635 wikihow.life .life 76
46,805 omroepwest.nl .nl 73
46,923 alisweb.org .org 31
46,939 southwalesargus.co.uk .uk 69
47,166 tu.berlin .berlin 64
47,173 eurogamer.de .de 57
47,228 newsandstar.co.uk .uk 71
47,299 rtvdrenthe.nl .nl 73
47,526 allgaeuer-zeitung.de .de 73
47,624 lacucinaitaliana.it .it 77
47,659 nationalgeographic.de .de 80
47,739 sportler.com .com 64
47,741 salzburg24.at .at 86
47,796 topekalibraries.info .info 38
47,884 vcstar.com .com 62
48,074 grubstreet.com .com 73
48,444 vogue.com.tw .tw 81
48,550 argusleader.com .com 62
49,061 posfie.com .com 73
49,067 gqitalia.it .it 64
49,194 mailonsunday.co.uk .uk 57
49,271 eltern.de .de 74
49,279 presstelegram.com .com 76
49,343 hd.se .se 52
49,420 gds.it .it 77
49,501 sj-r.com .com 64
49,574 montgomeryadvertiser.com .com 62
49,986 echo-news.co.uk .uk 71
50,267 worcesternews.co.uk .uk 71
50,278 burlingtonfreepress.com .com 74
50,312 mujerhoy.com .com 80
50,338 ohtuleht.ee .ee 64
50,367 blipfoto.com .com 57
50,684 gq.com.mx .mx 64
PreviousPage 3 of 3

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the DuckAssistBot reference, the full census, and the JSON endpoint.