Blocklist · OpenAI

Sites that block GPTBot

2,937 of the 29,991 domains we have measured, 10%, disallow gptbot at the site root in robots.txt. GPTBot collects content that may be used to train a model.

Every domain here has withheld its content from OpenAI's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,937 of 29,991 measured domains (10%) disallow gptbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block GPTBot", measured 2026-11-22. https://crawlcensus.com/blocked/gptbot

The list 2,937 domains

RankDomainTLDAI access score
9,983 xn--72caa3cygoc0d9c.com .com 60
10,006 1goplus.com .com 58
10,020 scoalarutiera.ro .ro 63
10,046 xn--6-lve1d0cya6hb2e.com .com 58
10,052 adcam.org .org 41
10,074 cope.es .es 86
10,083 animesalt.ac .ac 70
10,133 imvu.com .com 53
10,139 xn--y3ctaak9bb.com .com 80
10,144 sexiveo.com .com 62
10,157 ethiolottery.et .et 45
10,191 paryajlakay.com .com 45
10,210 u-money.money .money 43
10,279 klingai.com .com 78
10,320 mapy.com .com 52
10,345 inews.co.uk .uk 67
10,387 foxit.com .com 90
10,400 morgenpost.de .de 81
10,406 helpguide.org .org 90
10,409 nhm.ac.uk .uk 64
10,414 dailykos.com .com 86
10,432 expansion.com .com 81
10,470 babycenter.com .com 62
10,501 ocregister.com .com 80
10,508 foxitsoftware.com .com 90
10,527 bestwestern.com .com 54
10,539 bunkr.cr .cr 46
10,585 anyflip.com .com 56
10,596 uptodate.com .com 33
10,603 thediplomat.com .com 77
10,621 dailystar.co.uk .uk 47
10,680 f-droid.org .org 63
10,693 rawpixel.com .com 64
10,700 tampabay.com .com 84
10,702 healthychildren.org .org 71
10,727 radiotimes.com .com 80
10,777 netshort.com .com 87
10,781 47news.jp .jp 67
10,782 tutorialspoint.com .com 86
10,849 theme-fusion.com .com 71
10,852 embrapa.br .br 63
10,885 livestrong.com .com 80
10,894 augsburger-allgemeine.de .de 81
10,911 lwn.net .net 69
10,912 pbskids.org .org 62
10,913 wyborcza.pl .pl 66
10,933 rts.ch .ch 69
10,943 autoriteitpersoonsgegevens.nl .nl 80
10,952 informationweek.com .com 82
10,987 qu.ax .ax 63
10,997 oxfordlearnersdictionaries.com .com 62
11,005 airbnb.co.uk .uk 58
11,019 vinted.lt .lt 85
11,033 flathub.org .org 87
11,062 rsf.org .org 62
11,102 letyshops.com .com 60
11,107 bibliocommons.com .com 85
11,130 lexpress.fr .fr 86
11,145 lolalytics.com .com 60
11,147 intechopen.com .com 67
11,154 internshala.com .com 87
11,201 latercera.com .com 80
11,212 jdsupra.com .com 75
11,216 nola.com .com 64
11,255 whitebluerights.com .com 45
11,327 espn.co.uk .uk 48
11,349 posteo.de .de 67
11,367 abc7.com .com 81
11,385 freundin.de .de 89
11,389 cookiepro.com .com 75
11,390 pantone.com .com 78
11,457 wnp.pl .pl 65
11,481 fontanka.ru .ru 84
11,504 gamblingtherapy.org .org 87
11,516 cults3d.com .com 91
11,572 overheid.nl .nl 68
11,594 sitepoint.com .com 65
11,642 fap-guru.pro .pro 56
11,644 plurk.com .com 46
11,657 fishki.net .net 78
11,659 abendblatt.de .de 65
11,714 hackmd.io .io 88
11,746 fextralife.com .com 87
11,751 dailyrecord.co.uk .uk 47
11,813 basketball-reference.com .com 68
11,835 scispace.com .com 42
11,910 bcorporation.net .net 46
11,914 thehindubusinessline.com .com 65
12,001 winehq.org .org 57
12,055 nbcnewyork.com .com 33
12,058 wiwo.de .de 82
12,082 testmy.net .net 55
12,111 techpowerup.com .com 50
12,113 bostonherald.com .com 78
12,139 sltrib.com .com 83
12,149 showcamrips.com .com 56
12,154 g2288.com .com 55
12,165 uct.ac.za .za 78
12,227 iol.pt .pt 80
12,260 alternet.org .org 89
12,261 avclub.com .com 85
12,262 acog.org .org 82
12,280 laut.fm .fm 54
12,286 westeros.org .org 60
12,294 ally.com .com 94
12,310 elte.hu .hu 73
12,365 dailycaller.com .com 74
12,377 delfi.ee .ee 57
12,394 5-tv.ru .ru 92
12,401 vocabulary.com .com 76
12,410 7a0.com.br .br 56
12,441 novelfire.net .net 64
12,473 espn.com.do .do 48
12,521 mec.gov.br .br 43
12,533 indystar.com .com 73
12,655 case-battle.tel .tel 53
12,694 androidpolice.com .com 83
12,722 arabnok.com .com 73
12,726 lalibre.be .be 83
12,743 extremetech.com .com 64
12,753 tvguide.com .com 70
12,769 bokepsurga.com .com 45
12,786 tdxflix.fyi .fyi 75
12,795 cloudflare-quic.com .com 59
12,805 g777.ph .ph 44
12,806 speed-manga.net .net 78
12,822 iwara.tv .tv 30
12,839 3k.plus .plus 58
12,841 stltoday.com .com 80
12,843 fleetdm.com .com 77
12,856 famikura-store.jp .jp 49
12,863 qadcuteo.cc .cc 42
12,864 irishexaminer.com .com 89
12,879 gamisco.com .com 58
12,892 priotopic.com .com 72
12,898 scite.ai .ai 83
12,907 loadedfiles.org .org 57
12,921 playarenax.in .in 56
12,924 syfy.com .com 80
12,927 radiopaedia.org .org 53
12,972 noticiasaominuto.com .com 85
12,980 techtimes.com .com 73
12,990 nybooks.com .com 80
13,005 simpleflying.com .com 83
13,047 lunarclient.com .com 66
13,075 ahrq.gov .gov 72
13,091 elle.fr .fr 69
13,131 ranker.com .com 78
13,169 csoonline.com .com 86
13,176 iucnredlist.org .org 55
13,188 mobygames.com .com 68
13,201 hessenschau.de .de 87
13,243 snu.ac.kr .kr 70
13,277 mix.com .com 61
13,318 contentmarketinginstitute.com .com 82
13,321 cornelsen.de .de 91
13,333 wtop.com .com 74
13,381 bt4g.com .com 47
13,451 skyscrapercity.com .com 43
13,475 fotogramas.es .es 74
13,479 bnnbloomberg.ca .ca 81
13,532 doteasy.com .com 73
13,563 stuttgarter-zeitung.de .de 71
13,569 blitz.gg .gg 64
13,579 barcelona.cat .cat 82
13,604 faroutmagazine.co.uk .uk 72
13,617 latribune.fr .fr 72
13,667 dispatch.com .com 74
13,696 blackfaggot.online .online 42
13,699 freesound.org .org 71
13,719 payoneer.com .com 79
13,745 abczdrowie.pl .pl 92
13,763 bancolombia.com .com 81
13,772 khan.co.kr .kr 72
13,792 sheknows.com .com 83
13,821 hearstnetworks.com .com 79
13,825 heraldscotland.com .com 81
13,828 aeon.co .co 84
13,840 writeablog.net .net 51
13,860 francebleu.fr .fr 87
13,871 ilex.by .by 59
13,873 rappler.com .com 80
13,879 tennessean.com .com 74
13,882 vermont.gov .gov 73
13,930 myminifactory.com .com 38
13,932 bokepi.com .com 75
13,942 dnevnik.hr .hr 55
13,987 mydealz.de .de 79
14,009 abc7chicago.com .com 81
14,034 lrt.lt .lt 84
14,065 animesuge.cz .cz 71
14,066 pourvous.nl .nl 72
14,087 diepresse.com .com 80
14,090 simon.com .com 31
14,092 politiken.dk .dk 73
14,112 project-syndicate.org .org 88
14,138 mapy.cz .cz 52
14,153 ikiru.wtf .wtf 67
14,163 car-part.com .com 49
14,168 ncaa.com .com 85
PreviousPage 4 of 15Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the GPTBot reference, the full census, and the JSON endpoint.