Blocklist · DuckDuckGo

Sites that block DuckAssistBot

498 of the 29,991 domains we have measured, 2%, disallow duckassistbot at the site root in robots.txt. DuckAssistBot fetches a page live when a user asks the assistant for it.

Every domain here has removed itself from DuckDuckGo's answers. Blocking a retrieval agent withholds nothing from model training, because training uses a different token.

The measurement

498 of 29,991 measured domains (2%) disallow duckassistbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-21 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block DuckAssistBot", measured 2026-11-21. https://crawlcensus.com/blocked/duckassistbot

The list 498 domains

RankDomainTLDAI access score
12,743 extremetech.com .com 64
12,799 curbed.com .com 73
12,972 noticiasaominuto.com .com 85
13,213 hellomagazine.com .com 86
13,237 clicrbs.com.br .br 80
13,398 gq-magazine.co.uk .uk 81
13,419 vancouversun.com .com 71
13,579 barcelona.cat .cat 82
13,617 latribune.fr .fr 72
13,660 thrillist.com .com 70
13,667 dispatch.com .com 74
13,668 torontosun.com .com 71
13,704 trademe.co.nz .nz 56
13,825 heraldscotland.com .com 81
13,858 flashscore.co.za .za 70
13,860 francebleu.fr .fr 87
13,871 ilex.by .by 59
13,873 rappler.com .com 80
13,879 tennessean.com .com 74
14,092 politiken.dk .dk 73
14,374 delfi.lv .lv 80
14,612 mopo.de .de 79
14,826 rockpapershotgun.com .com 58
14,862 canada.com .com 71
15,174 pcgamesn.com .com 83
15,218 statesman.com .com 51
15,230 mysanantonio.com .com 54
15,269 gamesindustry.biz .biz 57
15,372 letudiant.fr .fr 81
15,401 desmoinesregister.com .com 74
15,476 computerbild.de .de 81
15,509 diariovasco.com .com 82
15,557 cincinnati.com .com 74
15,686 postimees.ee .ee 66
15,944 rtl.be .be 82
16,254 unil.ch .ch 83
16,317 ilmattino.it .it 62
16,564 mapgenie.io .io 59
16,664 lightningmaps.org .org 51
16,814 whattoexpect.com .com 65
17,042 northjersey.com .com 74
17,183 semafor.com .com 72
17,455 twincities.com .com 81
17,469 palmbeachpost.com .com 73
17,492 ina.fr .fr 76
17,522 daangn.com .com 71
17,536 seattlepi.com .com 54
17,886 agrarheute.com .com 75
18,071 flashscore.co.uk .uk 71
18,280 hoerzu.de .de 45
18,442 empireonline.com .com 62
18,522 thenews.com.pk .pk 65
18,687 romatoday.it .it 67
18,863 dailynews.com .com 76
18,867 adressa.no .no 66
18,870 scotusblog.com .com 83
18,883 courier-journal.com .com 74
18,894 courrierinternational.com .com 83
19,283 denik.cz .cz 77
19,314 milanotoday.it .it 67
19,342 bold.dk .dk 58
19,941 ottawacitizen.com .com 71
20,030 badische-zeitung.de .de 56
20,081 flashscore.com.tr .tr 70
20,318 supersport.hr .hr 51
20,362 thedodo.com .com 70
20,364 derwesten.de .de 83
20,481 flashscore.pt .pt 72
20,858 flashscore.vn .vn 72
20,871 lavenir.net .net 83
20,958 pressdemocrat.com .com 80
21,038 mainpost.de .de 80
21,267 seher.no .no 70
21,415 bangordailynews.com .com 71
21,685 calgaryherald.com .com 71
21,823 desy.de .de 62
22,007 vg247.com .com 58
22,596 flashscore.gr .gr 72
22,623 mcall.com .com 78
23,084 app.com .com 69
24,014 askmen.com .com 47
24,102 knoxnews.com .com 74
24,141 cntraveller.com .com 81
24,190 jacksonville.com .com 74
24,233 glamourmagazine.co.uk .uk 81
24,468 flashscore.de .de 71
24,525 zin.ru .ru 41
24,593 vogue.in .in 64
24,882 uol.com .com 82
24,892 eldiariomontanes.es .es 82
24,946 vogue.fr .fr 81
24,961 miaminewtimes.com .com 73
24,977 wired.it .it 83
24,983 sn.at .at 70
25,031 franceculture.fr .fr 81
25,048 tokyo-np.co.jp .jp 81
25,115 pilotonline.com .com 79
25,133 myrecipes.com .com 77
25,184 kompasiana.com .com 85
25,237 flashscorekz.com .com 70
25,478 franceinter.fr .fr 80
25,653 livesport.com .com 69
25,677 flashscore.in .in 70
25,756 ctinsider.com .com 54
25,839 delawareonline.com .com 74
25,903 heraldtribune.com .com 73
25,911 arkansasonline.com .com 71
26,114 democratandchronicle.com .com 73
26,379 brisbanetimes.com.au .au 75
26,444 pap.pl .pl 39
26,474 mbta.com .com 64
26,637 brigitte.de .de 79
26,853 tallahassee.com .com 74
26,935 fd.nl .nl 73
27,696 staradvertiser.com .com 84
27,723 geek.com .com 38
27,838 mtvuutiset.fi .fi 72
28,170 suedkurier.de .de 81
28,616 amzn.com .com 40
28,642 nachrichten.at .at 82
28,678 thenational.scot .scot 81
28,775 vogue.de .de 65
28,794 eastbaytimes.com .com 79
28,930 championcross.jp .jp 62
28,950 acronymfinder.com .com 65
29,048 gq-magazin.de .de 66
29,139 u-cursos.cl .cl 51
29,273 expressnews.com .com 54
29,390 kompas.id .id 64
29,402 mmafighting.com .com 68
29,499 conjur.com.br .br 73
29,553 hankookilbo.com .com 84
29,567 ctpost.com .com 54
29,572 flashscore.com.mx .mx 70
29,634 westword.com .com 77
29,639 edmontonjournal.com .com 71
29,821 providencejournal.com .com 73
30,052 lasprovincias.es .es 82
30,074 yugipedia.com .com 58
30,196 youngchampion.jp .jp 62
30,237 clarionledger.com .com 74
30,387 bsc.es .es 37
30,443 dobrzemieszkaj.pl .pl 61
30,703 wickedlocal.com .com 75
30,737 diariosur.es .es 82
30,810 kentonline.co.uk .uk 76
30,986 commercialappeal.com .com 74
30,992 huffingtonpost.it .it 83
31,023 phoenixnewtimes.com .com 71
31,032 howlongtobeat.com .com 49
31,138 ideal.es .es 82
31,176 edp24.co.uk .uk 79
31,282 vndb.org .org 60
31,320 lumendatabase.org .org 51
31,352 sportsbusinessjournal.com .com 53
31,499 bolasport.com .com 76
31,549 lohud.com .com 74
31,786 thespec.com .com 64
31,871 diariodesevilla.es .es 84
32,032 prx.org .org 74
32,267 theargus.co.uk .uk 79
32,388 rgj.com .com 73
32,437 hoopshype.com .com 70
32,579 dallasobserver.com .com 77
32,617 flo.com.tr .tr 52
32,790 tatler.com .com 82
32,803 oxfordmail.co.uk .uk 79
32,806 tvnet.lv .lv 79
32,918 laverdad.es .es 82
33,254 aan.com .com 74
33,349 qq8893.com .com 68
33,793 observer.co.uk .uk 74
34,097 vogue.es .es 65
34,309 unionleader.com .com 63
34,445 monoskop.org .org 43
34,750 mailplus.co.uk .uk 44
34,847 sydsvenskan.se .se 52
34,973 naplesnews.com .com 73
35,062 dailypress.com .com 79
35,543 news-journalonline.com .com 73
35,759 houseandgarden.co.uk .uk 81
36,120 elcomercio.es .es 82
36,237 saltwire.com .com 70
36,334 ytmnd.com .com 41
36,356 elgaronline.com .com 45
36,436 liquor.com .com 77
36,539 nd-aktuell.de .de 78
36,575 dailyecho.co.uk .uk 81
37,154 r777.net .net 51
37,367 mittelbayerische.de .de 77
38,007 wired.jp .jp 78
38,148 news-press.com .com 73
38,327 inforum.com .com 70
38,409 igt.com .com 48
38,507 bournemouthecho.co.uk .uk 79
38,668 stimme.de .de 72
38,876 elnortedecastilla.es .es 82
38,945 postype.com .com 81
39,206 futurezone.de .de 86
39,303 watoday.com.au .au 75
PreviousPage 2 of 3Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the DuckAssistBot reference, the full census, and the JSON endpoint.