Blocklist · OpenAI

Sites that block GPTBot

2,937 of the 29,991 domains we have measured, 10%, disallow gptbot at the site root in robots.txt. GPTBot collects content that may be used to train a model.

Every domain here has withheld its content from OpenAI's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,937 of 29,991 measured domains (10%) disallow gptbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block GPTBot", measured 2026-11-22. https://crawlcensus.com/blocked/gptbot

The list 2,937 domains

RankDomainTLDAI access score
42,248 architecture.com .com 59
42,249 fox13seattle.com .com 87
42,260 rcgroups.com .com 41
42,262 advrider.com .com 41
42,289 warosu.org .org 47
42,290 news5cleveland.com .com 85
42,293 tfd.com .com 69
42,336 eweka.nl .nl 75
42,353 priuschat.com .com 55
42,423 welib.org .org 49
42,432 sqlservercentral.com .com 94
42,463 grillio.com .com 53
42,478 cbs6albany.com .com 72
42,505 medietall.no .no 48
42,512 tech-ties.net .net 85
42,592 erowid.org .org 40
42,595 101soundboards.com .com 78
42,607 wruser.org .org 43
42,611 podimo.com .com 70
42,614 citizen-times.com .com 74
42,651 computerwoche.de .de 85
42,670 wy903.com .com 53
42,682 opinautos.com .com 52
42,698 sol.no .no 74
42,728 wishtv.com .com 80
42,732 wizaz.pl .pl 84
42,733 wfsb.com .com 78
42,800 1000kitap.com .com 42
42,835 iodonna.it .it 86
42,842 bahamaslocal.com .com 61
42,849 hoganlovells.com .com 81
42,862 horseracingnation.com .com 72
42,863 textstudio.com .com 74
42,874 kone.gg .gg 58
42,889 canalsur.es .es 89
42,905 efinancialcareers.com .com 90
42,906 bilh.org .org 92
42,919 tcrf.net .net 29
42,934 v2006.com .com 49
42,935 ugmk-telecom.ru .ru 63
42,960 ceskenoviny.cz .cz 68
42,978 prospectmagazine.co.uk .uk 70
42,981 viewbug.com .com 83
43,089 port.hu .hu 68
43,117 polycasino.com .com 76
43,122 urbia.de .de 86
43,126 xfolio.jp .jp 72
43,132 jtbc.co.kr .kr 70
43,138 jobserve.com .com 69
43,140 gimmesomeoven.com .com 88
43,207 tv4play.se .se 77
43,216 onetz.de .de 89
43,222 udiscovermusic.com .com 84
43,251 sufficientvelocity.com .com 73
43,260 exchange-rates.org .org 81
43,263 blr.com .com 94
43,268 candlepowerforums.com .com 61
43,281 xvix.eu .eu 75
43,302 seacoastonline.com .com 69
43,309 tonkeeper.com .com 57
43,315 stateline.org .org 69
43,325 news3lv.com .com 73
43,329 skinnytaste.com .com 90
43,414 cameradb.review .review 62
43,415 pokeheroes.com .com 57
43,437 derbytelegraph.co.uk .uk 47
43,452 katestube.com .com 73
43,455 noi.md .md 54
43,480 remoteok.com .com 76
43,544 nautiljon.com .com 62
43,578 pixmania.com .com 88
43,605 zonerama.com .com 30
43,618 3gpp.org .org 53
43,666 tasty.co .co 79
43,667 sweclockers.com .com 63
43,671 pbtech.co.nz .nz 82
43,673 ojogo.pt .pt 69
43,677 lightpdf.com .com 86
43,715 carsdirect.com .com 86
43,742 apsnet.org .org 50
43,802 fussballdaten.de .de 76
43,804 lapatilla.com .com 85
43,883 kctv5.com .com 78
43,890 21jingji.com .com 65
43,909 gipuzkoa.eus .eus 70
43,967 caixinglobal.com .com 82
43,986 nn.de .de 83
43,996 supermarketnews.com .com 82
44,007 vanguardia.com .com 83
44,026 gainesville.com .com 66
44,041 cambridge-news.co.uk .uk 47
44,043 matters.town .town 56
44,055 270towin.com .com 72
44,057 currencyaz.com .com 55
44,077 airbnb.jp .jp 58
44,099 wistv.com .com 76
44,101 icontact.com .com 73
44,104 airbnb.nl .nl 58
44,116 eevblog.com .com 76
44,136 bookbeat.com .com 68
44,151 betterbanned.com .com 71
44,155 lbbonline.com .com 70
44,169 fox5vegas.com .com 76
44,228 notionpress.com .com 64
44,230 mcpvp.club .club 50
44,252 braunschweiger-zeitung.de .de 65
44,313 um.ac.id .id 83
44,320 reviewed.com .com 87
44,349 nhnieuws.nl .nl 74
44,404 umm.edu .edu 77
44,418 adoptimix.com .com 68
44,434 livescores.com .com 85
44,435 thekrazycouponlady.com .com 74
44,440 hitmaal.io .io 71
44,450 infoseek.com .com 76
44,489 iha.com.tr .tr 52
44,509 rennrad-news.de .de 87
44,512 pinknews.co.uk .uk 90
44,513 esalah.com .com 81
44,529 ajunews.com .com 88
44,530 parfumo.com .com 76
44,556 tritan.gg .gg 61
44,575 flgov.com .com 54
44,635 wowinterface.com .com 58
44,689 notthebee.com .com 79
44,723 dailygazette.com .com 80
44,724 sunstar.com.ph .ph 82
44,780 virgool.io .io 58
44,807 gofeminin.de .de 74
44,829 mobilism.org .org 48
44,837 winelab.ru .ru 72
44,860 airbnb.co.za .za 58
44,874 news-leader.com .com 62
44,878 rtvnoord.nl .nl 73
44,880 santaads.com .com 73
44,889 bcferries.com .com 77
44,904 popup-blocker.org .org 56
44,908 mora.jp .jp 45
44,912 audima.co .co 80
44,928 wgt.com .com 80
44,930 jogatina.com .com 80
44,946 cornwalllive.com .com 47
44,962 abc6onyourside.com .com 71
44,968 savannahnow.com .com 64
45,002 babycentre.co.uk .uk 62
45,003 preciso.net .net 57
45,063 wkyt.com .com 78
45,064 erepublik.com .com 62
45,120 cmha.ca .ca 76
45,150 samplefocus.com .com 60
45,157 durev-inc.xyz .xyz 59
45,158 autoguide.com .com 87
45,159 lansingstatejournal.com .com 62
45,165 parkpage.in .in 41
45,180 pivotalweather.com .com 25
45,184 kshb.com .com 85
45,195 natgeotv.com .com 81
45,216 tbcpl.lol .lol 59
45,243 abcnews4.com .com 67
45,250 e-pages.dk .dk 50
45,271 deckshop.pro .pro 63
45,272 rtvutrecht.nl .nl 73
45,298 osapublishing.org .org 65
45,316 eumetsat.int .int 80
45,334 virtuoso.com .com 63
45,339 tvguide.co.uk .uk 88
45,349 wp.de .de 65
45,356 pokewiki.de .de 55
45,358 nema.org .org 59
45,372 devid.info .info 57
45,375 cleveland19.com .com 78
45,390 tupalo.com .com 57
45,415 agoravox.fr .fr 69
45,440 nrz.de .de 80
45,461 lgbtqnation.com .com 72
45,482 iyottube.ph .ph 68
45,509 hysky.de .de 38
45,536 bvb-alyans.ru .ru 80
45,541 classiccat.net .net 50
45,571 wz.de .de 76
45,578 chugoku-np.co.jp .jp 80
45,602 kenhub.com .com 66
45,604 beaconjournal.com .com 66
45,605 soccer365.net .net 47
45,621 fuelly.com .com 54
45,663 autoauctionhistory.com .com 46
45,678 news4sanantonio.com .com 67
45,680 greenvilleonline.com .com 62
45,704 diariodeleon.es .es 91
45,716 ithome.com.tw .tw 56
45,718 fanforum.com .com 47
45,719 euro-football.ru .ru 74
45,748 esaunggul.ac.id .id 73
45,771 larioja.com .com 83
45,779 bluradio.com .com 89
45,813 maza18.me .me 73
45,828 spin.de .de 71
45,844 gazetevatan.com .com 86
45,846 amazon.jp .jp 40
45,850 gloucestershirelive.co.uk .uk 47
PreviousPage 13 of 15Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the GPTBot reference, the full census, and the JSON endpoint.