Blocklist · OpenAI

Sites that block GPTBot

2,937 of the 29,991 domains we have measured, 10%, disallow gptbot at the site root in robots.txt. GPTBot collects content that may be used to train a model.

Every domain here has withheld its content from OpenAI's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,937 of 29,991 measured domains (10%) disallow gptbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block GPTBot", measured 2026-11-22. https://crawlcensus.com/blocked/gptbot

The list 2,937 domains

RankDomainTLDAI access score
38,526 haystack.tv .tv 88
38,568 stanfordchildrens.org .org 84
38,581 turboquestz.com .com 56
38,603 avj-th.com .com 79
38,609 teensexmix.site .site 71
38,612 xemvl.xxx .xxx 67
38,633 pufted.com .com 35
38,648 wfmu.org .org 54
38,668 stimme.de .de 72
38,679 newschannel5.com .com 85
38,701 multitran.com .com 62
38,708 lursoft.lv .lv 63
38,711 casinotest2.com .com 75
38,713 navyteams.com .com 77
38,737 warhammer-community.com .com 85
38,739 thueringer-allgemeine.de .de 82
38,752 ixiporn.club .club 68
38,790 passportindex.org .org 50
38,812 activerain.com .com 70
38,814 mas.to .to 31
38,830 rollitup.org .org 83
38,836 winzaa.club .club 36
38,841 gameplayup.com .com 45
38,856 salidzini.lv .lv 66
38,875 bluemoon-mcfc.co.uk .uk 50
38,876 elnortedecastilla.es .es 82
38,944 msg.group .group 91
38,945 postype.com .com 81
38,971 uwm.com .com 59
39,014 nagawinhoki.com .com 75
39,059 mozillafoundation.org .org 55
39,082 1fun.plus .plus 56
39,088 dearlottery.in .in 90
39,094 ind1.bet .bet 58
39,100 latestallgames.com .com 72
39,114 vildeey.site .site 43
39,115 vivicomi21.info .info 70
39,118 xn--3-5wf2bubl3iwbf1f5e8d.com .com 71
39,121 reference-global.com .com 74
39,206 futurezone.de .de 86
39,210 thecentersquare.com .com 78
39,255 grop.net .net 57
39,281 teltarif.de .de 86
39,303 watoday.com.au .au 75
39,324 eurochem.ru .ru 87
39,349 hoy.es .es 82
39,350 thehighline.org .org 77
39,369 santafenewmexican.com .com 76
39,393 zakzak.co.jp .jp 72
39,471 vwvortex.com .com 43
39,516 muz.uz .uz 70
39,531 hankooki.com .com 72
39,536 buscape.com.br .br 80
39,540 ky3.com .com 77
39,570 roletapixbr.com .com 51
39,578 1news.co.nz .nz 82
39,587 hulldailymail.co.uk .uk 47
39,597 indifferentlanguages.com .com 52
39,633 telanganatoday.com .com 90
39,657 korben.info .info 77
39,682 vinted.gr .gr 86
39,692 netdoktor.de .de 79
39,700 1gb.ua .ua 64
39,703 deepsilver.com .com 70
39,706 indiehackers.com .com 54
39,712 vsbattles.com .com 68
39,713 learner.org .org 65
39,806 mercateo.com .com 48
39,824 werstreamt.es .es 59
39,826 ticketmaster.be .be 85
39,833 rnz.de .de 73
39,950 dholding.ru .ru 56
39,953 imaging-resource.com .com 79
39,976 aifpleasurebeh.org .org 35
39,990 stackoverflow.blog .blog 78
40,005 bobdylan.com .com 58
40,006 gemtracks.com .com 66
40,013 belfastlive.co.uk .uk 47
40,037 foxbaltimore.com .com 67
40,049 hpcwire.com .com 63
40,068 intelligentgolf.co.uk .uk 66
40,102 eurasianet.org .org 56
40,114 cgm.com .com 75
40,163 worldnomads.com .com 81
40,177 findmine.com .com 56
40,219 thegrio.com .com 89
40,235 wlos.com .com 71
40,258 listchallenges.com .com 48
40,267 contabeis.com.br .br 78
40,278 dmhy.org .org 59
40,317 iza.ne.jp .jp 79
40,322 neatorama.com .com 55
40,328 bntu.by .by 80
40,339 kompas.tv .tv 76
40,347 emedicinehealth.com .com 78
40,360 noen.at .at 79
40,367 centralcharts.com .com 58
40,403 thelocal.fr .fr 87
40,411 kmib.co.kr .kr 47
40,413 dualshockers.com .com 83
40,419 fox19.com .com 78
40,487 opendatabot.ua .ua 58
40,495 yahoo.com.tw .tw 59
40,511 prompthero.com .com 81
40,512 thetelegraphandargus.co.uk .uk 78
40,527 nationalgeographic.fr .fr 91
40,536 snl.no .no 87
40,537 sarna.net .net 81
40,627 ovh.co.uk .uk 89
40,638 main-echo.de .de 64
40,703 mrst.one .one 52
40,713 dwds.de .de 64
40,740 sheetjs.com .com 59
40,741 theblast.com .com 92
40,775 wcax.com .com 77
40,784 thedenverchannel.com .com 85
40,796 elpasotimes.com .com 73
40,805 straight.com .com 79
40,817 cancilleria.gov.co .co 60
40,830 xink.io .io 78
40,858 inspiredtaste.net .net 70
40,859 practicalmachinist.com .com 67
40,863 bienpublic.com .com 83
40,868 sayweee.com .com 72
40,874 grid.id .id 64
40,904 nesn.com .com 73
40,912 saambaa.com .com 66
40,961 wplace.live .live 73
40,968 kontan.co.id .id 77
40,969 nrn.com .com 81
40,971 amlegal.com .com 76
40,973 amainhobbies.com .com 47
41,016 hockeydb.com .com 53
41,019 tmj4.com .com 83
41,083 summitpost.org .org 56
41,088 ispe.org .org 67
41,104 stokesentinel.co.uk .uk 47
41,121 lancashiretelegraph.co.uk .uk 78
41,140 rixos.com .com 69
41,203 analdin.xxx .xxx 44
41,204 elpuntavui.cat .cat 36
41,227 musescore.org .org 55
41,232 chipsmall.com .com 82
41,235 tampabay28.com .com 85
41,295 newson6.com .com 82
41,308 sunbeltrentals.com .com 79
41,310 businessinsider.jp .jp 89
41,317 waymarking.com .com 48
41,319 uwsp.edu .edu 90
41,336 archinect.com .com 68
41,349 planet-wissen.de .de 71
41,357 mamul.am .am 66
41,361 fox26houston.com .com 87
41,394 capitalizemytitle.com .com 71
41,396 voe.sx .sx 69
41,420 prq.to .to 42
41,459 saharareporters.com .com 53
41,465 naughtyamerica.com .com 54
41,474 abc3340.com .com 73
41,519 greenme.it .it 82
41,542 oefb.at .at 50
41,577 weblly.com .com 86
41,590 at5.nl .nl 70
41,603 lci.fr .fr 84
41,614 thebulwark.com .com 54
41,617 taptap.io .io 80
41,647 cjonline.com .com 73
41,652 flowmusic.app .app 64
41,653 donaukurier.de .de 78
41,678 usna.edu .edu 71
41,709 seneweb.com .com 86
41,713 roanoke.com .com 80
41,721 canarias7.es .es 83
41,736 eadt.co.uk .uk 79
41,760 dailybreeze.com .com 76
41,802 wyzant.com .com 79
41,824 smiletemplates.com .com 47
41,826 defcon.org .org 66
41,851 pixelfed.social .social 46
41,865 thehealthy.com .com 87
41,892 icook.tw .tw 89
41,934 crikey.com.au .au 88
41,958 theledger.com .com 74
41,962 okinawatimes.co.jp .jp 79
41,971 gallimard.fr .fr 77
41,980 aqi.in .in 75
41,987 intermountainhealthcare.org .org 63
41,999 slub-dresden.de .de 71
42,010 aprs.fi .fi 41
42,022 eluniversal.com.co .co 84
42,076 iex.nl .nl 48
42,086 nintendoeverything.com .com 89
42,099 ephotozine.com .com 64
42,105 odi.org .org 54
42,112 news9.com .com 85
42,113 glasgowtimes.co.uk .uk 79
42,159 elheraldo.co .co 88
42,160 tcpalm.com .com 73
42,192 weserv.nl .nl 55
42,222 boomi.in .in 77
PreviousPage 12 of 15Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the GPTBot reference, the full census, and the JSON endpoint.