Blocklist · OpenAI

Sites that block GPTBot

2,937 of the 29,991 domains we have measured, 10%, disallow gptbot at the site root in robots.txt. GPTBot collects content that may be used to train a model.

Every domain here has withheld its content from OpenAI's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,937 of 29,991 measured domains (10%) disallow gptbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block GPTBot", measured 2026-11-22. https://crawlcensus.com/blocked/gptbot

The list 2,937 domains

RankDomainTLDAI access score
35,370 akniga.org .org 92
35,373 foreca.net .net 71
35,383 alexishave.com .com 66
35,387 alexistogel.ninja .ninja 72
35,388 arabxn.watch .watch 77
35,389 auntymaza.wiki .wiki 70
35,395 dutasexx.bond .bond 79
35,397 egy.sex .sex 58
35,403 makmur76.digital .digital 75
35,404 mapadeapellidos.com .com 75
35,413 socialsecuritywb.com .com 75
35,416 under250art.ca .ca 79
35,468 ewn.co.za .za 68
35,488 seminarycentral.org .org 57
35,504 unityroom.com .com 53
35,517 datacenterknowledge.com .com 82
35,519 youglish.com .com 59
35,530 comicland.org .org 49
35,543 news-journalonline.com .com 73
35,557 mediaindonesia.com .com 80
35,565 lectormangass.com .com 77
35,579 secondhandsongs.com .com 50
35,586 color-hex.com .com 51
35,598 zyukj2l.com .com 41
35,663 globalwitness.org .org 62
35,670 spine-health.com .com 74
35,684 americanrhetoric.com .com 45
35,692 hitmaal.tv .tv 71
35,723 wtvr.com .com 85
35,738 styry.com .com 82
35,742 xarxx.xxx .xxx 75
35,760 montgomerycountymd.gov .gov 65
35,762 bubbl.us .us 69
35,763 penguin.de .de 88
35,784 lostshorts.com .com 42
35,800 wn.de .de 80
35,803 housepricesintheuk.co.uk .uk 74
35,805 hentaistube.com .com 68
35,828 dotdashmeredith.com .com 64
35,862 expertise.com .com 77
35,871 earth911.com .com 86
35,896 studylight.org .org 76
35,907 dailytimes.com.pk .pk 74
35,914 gaigu15.net .net 59
35,917 cyberscoop.com .com 91
35,944 yomovies.institute .institute 70
35,953 redflagdeals.com .com 44
35,955 oekotest.de .de 86
35,976 bokepindo13.center .center 71
35,981 cuevana3.cl .cl 84
35,982 damconuong.mom .mom 82
35,995 hdmaal.to .to 55
36,001 koray.live .live 75
36,002 lapinede-aix.fr .fr 79
36,008 mariatogel71.com .com 75
36,012 maza18.org .org 73
36,013 mdg188sky.site .site 74
36,017 moviezmad.live .live 71
36,022 partaitogel76.com .com 73
36,038 rogmovies.work .work 61
36,050 ssrmovies.ch .ch 59
36,053 teensexmix.cyou .cyou 71
36,055 thereissearch.com .com 60
36,059 toto12ace.com .com 74
36,060 toto12sphynx.org .org 79
36,068 vinahentai.bond .bond 84
36,069 vinahentai.cloud .cloud 84
36,075 xmazaa.io .io 66
36,080 ydparty01.tv .tv 86
36,120 elcomercio.es .es 82
36,154 hashthemes.com .com 82
36,172 tfw2005.com .com 73
36,174 telemadrid.es .es 89
36,181 nsn-now.com .com 46
36,205 fair.org .org 54
36,208 chaos.social .social 51
36,225 gomotionapp.com .com 84
36,269 inkl.com .com 50
36,334 ytmnd.com .com 41
36,356 elgaronline.com .com 45
36,359 nasaspaceflight.com .com 66
36,369 gymmasteronline.com .com 63
36,370 shindanmaker.com .com 51
36,434 businessday.co.za .za 82
36,449 aek365.org .org 61
36,480 desired.de .de 82
36,501 ctext.org .org 60
36,539 nd-aktuell.de .de 78
36,568 bookcrossing.com .com 38
36,575 dailyecho.co.uk .uk 81
36,590 fagerneek.com .com 57
36,630 roadsideamerica.com .com 72
36,658 forzastyle.com .com 77
36,668 uqload.is .is 61
36,702 299betvip.com .com 51
36,718 arynews.tv .tv 91
36,728 wienerzeitung.at .at 76
36,737 moneyhouse.ch .ch 72
36,743 fcps.edu .edu 64
36,755 lalsace.fr .fr 82
36,757 wsmv.com .com 76
36,761 scrippsnews.com .com 85
36,768 mamshirt.com .com 57
36,770 vturb.com .com 55
36,778 cwmars.org .org 43
36,800 pedigreedatabase.com .com 63
36,803 tennis.com .com 59
36,805 aman.com .com 68
36,818 wssolver.net .net 62
36,827 verdi.de .de 58
36,832 scoremer.com .com 36
36,838 globalprimereport.com .com 42
36,840 budgetbytes.com .com 80
36,872 medical-xprt.com .com 54
36,895 uokik.gov.pl .pl 85
36,926 globalpost.com .com 83
36,937 idowa.de .de 90
36,980 rak8s.com .com 49
37,032 asahq.org .org 62
37,049 sportsline.com .com 89
37,070 073m.com .com 52
37,150 taximaxim.com .com 60
37,152 stuttgart.de .de 71
37,154 r777.net .net 51
37,158 viddler.com .com 78
37,171 rcuniverse.com .com 74
37,175 minimalistbaker.com .com 90
37,204 rlifiles.com .com 92
37,297 storyblocks.com .com 70
37,305 hotcars.com .com 82
37,317 bloodyelbow.com .com 88
37,321 thesamba.com .com 42
37,323 esquire.de .de 89
37,342 eternalmangas.org .org 77
37,367 mittelbayerische.de .de 77
37,397 mercadolibre.com.ec .ec 64
37,411 desisex.xxx .xxx 65
37,415 tapinto.net .net 35
37,425 jamestown.org .org 82
37,429 imfdb.org .org 47
37,456 theicct.org .org 72
37,478 sslshopper.com .com 61
37,501 cityoflondon.gov.uk .uk 60
37,504 technews.tw .tw 70
37,522 twinkl.com .com 37
37,566 numberempire.com .com 73
37,571 westermann.de .de 73
37,598 justapinch.com .com 71
37,613 unescap.org .org 72
37,638 globalbunjang.com .com 89
37,643 bk333.app .app 51
37,671 aerobasegroup.com .com 68
37,674 leicestermercury.co.uk .uk 47
37,700 rutracker.net .net 43
37,714 abcya.com .com 54
37,724 mmsvibex.net .net 81
37,738 infoclimat.fr .fr 49
37,757 elle.de .de 89
37,762 mywebnook.com .com 60
37,807 xn--72czpfe7gxb9cveycua.com .com 74
37,810 focus.it .it 69
37,830 autoscout24.nl .nl 86
37,874 484r.com .com 55
37,894 cookieandkate.com .com 86
37,902 iso-group.com .com 93
37,913 samaritanspurse.org .org 70
37,934 dvdtalk.com .com 69
38,015 thetravel.com .com 81
38,024 arab89.net .net 60
38,037 luscious.net .net 70
38,068 bully-manga.com .com 81
38,069 kyawgyi.com .com 69
38,114 sportico.com .com 64
38,115 koleo.pl .pl 76
38,118 abc30.com .com 81
38,129 11freunde.de .de 58
38,148 news-press.com .com 73
38,176 saskatchewan.ca .ca 68
38,193 ardsounds.de .de 85
38,224 kptv.com .com 78
38,234 vinted.com.au .au 68
38,236 datasheetq.com .com 51
38,247 moviemaker.com .com 90
38,252 genengnews.com .com 75
38,313 wingsmob.com .com 57
38,323 marineinsight.com .com 92
38,327 inforum.com .com 70
38,328 borsen.dk .dk 74
38,350 definitions.net .net 54
38,357 arenapro6.com .com 53
38,388 goldderby.com .com 74
38,406 icecat.us .us 61
38,409 igt.com .com 48
38,420 kinipaham.com .com 37
38,437 ersnet.org .org 81
38,455 philanthropy.com .com 75
38,482 royalacademy.org.uk .uk 52
38,502 kantotplus.com .com 79
38,507 bournemouthecho.co.uk .uk 79
38,519 kochbar.de .de 62
PreviousPage 11 of 15Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the GPTBot reference, the full census, and the JSON endpoint.