Blocklist · OpenAI

Sites that block GPTBot

2,937 of the 29,991 domains we have measured, 10%, disallow gptbot at the site root in robots.txt. GPTBot collects content that may be used to train a model.

Every domain here has withheld its content from OpenAI's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,937 of 29,991 measured domains (10%) disallow gptbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block GPTBot", measured 2026-11-22. https://crawlcensus.com/blocked/gptbot

The list 2,937 domains

RankDomainTLDAI access score
23,957 essential.gg .gg 73
23,964 pcwelt.de .de 78
24,000 icecat.biz .biz 44
24,014 askmen.com .com 47
24,022 twinkl.co.uk .uk 37
24,028 canberratimes.com.au .au 79
24,046 thisiscolossal.com .com 85
24,102 knoxnews.com .com 74
24,128 altushost.com .com 89
24,154 novaskin.me .me 51
24,184 ktvu.com .com 85
24,190 jacksonville.com .com 74
24,199 sciam.com .com 78
24,238 tweaktown.com .com 78
24,307 ewtn.com .com 70
24,354 youtubers.me .me 70
24,410 castanet.net .net 66
24,413 irishmirror.ie .ie 47
24,453 dragcave.net .net 61
24,485 lifesitenews.com .com 89
24,505 megasmp.gg .gg 84
24,520 nbcboston.com .com 33
24,525 zin.ru .ru 41
24,567 newspicks.com .com 44
24,569 local10.com .com 69
24,574 digitimes.com .com 58
24,575 dreame.com .com 74
24,603 globalknowledge.com .com 61
24,612 blogbright.net .net 53
24,655 penny-arcade.com .com 52
24,657 blockshopper.com .com 57
24,661 librivox.org .org 55
24,710 tricolor.ru .ru 65
24,712 bizzabo.com .com 90
24,714 occrp.org .org 62
24,715 rspca.org.uk .uk 72
24,733 humanite.fr .fr 87
24,744 advisor.travel .travel 46
24,747 jazz.com.pk .pk 46
24,752 cdprojektred.com .com 83
24,754 aol.co.uk .uk 66
24,783 pcgameshardware.de .de 72
24,802 bristolpost.co.uk .uk 47
24,819 payanyway.ru .ru 71
24,842 sdstate.edu .edu 74
24,853 nameswriter.com .com 48
24,878 happycolorapp.com .com 77
24,892 eldiariomontanes.es .es 82
24,934 svtplay.se .se 78
24,961 miaminewtimes.com .com 73
24,983 sn.at .at 70
25,031 franceculture.fr .fr 81
25,048 tokyo-np.co.jp .jp 81
25,065 ny1.com .com 68
25,093 abc15.com .com 85
25,108 wheree.com .com 86
25,115 pilotonline.com .com 79
25,116 newser.com .com 69
25,131 ausfreeslots.com .com 77
25,184 kompasiana.com .com 85
25,199 defenseone.com .com 89
25,221 cpubenchmark.net .net 70
25,227 soft112.com .com 74
25,239 greatist.com .com 80
25,270 startersites.io .io 46
25,299 pageloft.de .de 80
25,391 americastestkitchen.com .com 80
25,392 bsportsfan.com .com 76
25,451 omaha.com .com 80
25,453 research.com .com 70
25,478 franceinter.fr .fr 80
25,516 fox5atlanta.com .com 87
25,521 kolide.com .com 80
25,564 theadvocate.com .com 71
25,576 giraffic.com .com 75
25,587 sfexaminer.com .com 69
25,602 behindthename.com .com 52
25,606 meteotrend.com .com 49
25,620 dutchnews.nl .nl 86
25,625 americanthinker.com .com 56
25,632 commonwealthfund.org .org 63
25,637 celebritynetworth.com .com 86
25,662 experiment.com .com 60
25,670 cp24.com .com 81
25,678 consequence.net .net 85
25,748 booru.org .org 54
25,776 zinio.com .com 76
25,796 shopltk.com .com 83
25,797 wuytl.com .com 51
25,839 delawareonline.com .com 74
25,855 deutsche-rentenversicherung.de .de 79
25,903 heraldtribune.com .com 73
25,911 arkansasonline.com .com 71
25,939 moneydj.com .com 64
25,993 vivodemisrentas.net .net 57
26,005 people.inc .inc 64
26,091 cmswire.com .com 90
26,108 kebirhost.com .com 79
26,114 democratandchronicle.com .com 73
26,151 vinted.at .at 85
26,155 attendanceondemand.com .com 60
26,178 atgtickets.com .com 69
26,196 nextgov.com .com 86
26,210 kstp.com .com 83
26,235 rosettastone.com .com 74
26,240 yogajournal.com .com 77
26,261 indiaforums.com .com 59
26,284 daytondailynews.com .com 67
26,322 gimkit.com .com 42
26,342 straightdope.com .com 76
26,364 framagit.org .org 69
26,379 brisbanetimes.com.au .au 75
26,400 alternatehistory.com .com 62
26,408 xozilla.xxx .xxx 58
26,411 lanit.ru .ru 69
26,433 on.cc .cc 78
26,444 pap.pl .pl 39
26,474 mbta.com .com 64
26,479 theparisreview.org .org 55
26,505 astralane.io .io 83
26,511 denver7.com .com 85
26,558 tadex.id .id 63
26,567 spox.com .com 81
26,636 northropgrumman.com .com 83
26,637 brigitte.de .de 79
26,653 bas.bg .bg 82
26,672 subscan.io .io 53
26,684 thepinknews.com .com 90
26,695 fox13news.com .com 87
26,707 classcentral.com .com 71
26,708 bestplaces.net .net 61
26,751 eluniverso.com .com 76
26,799 anobii.com .com 53
26,806 golf.com .com 88
26,840 altroconsumo.it .it 91
26,842 unherd.com .com 83
26,843 additudemag.com .com 93
26,845 spin.com .com 70
26,853 tallahassee.com .com 74
26,877 bold.co .co 74
26,906 unmineable.com .com 79
26,922 studenti.it .it 89
26,935 fd.nl .nl 73
26,949 vocus.cc .cc 78
26,963 premiumoutlets.com .com 31
26,970 airbnb.de .de 57
27,001 mymrbet.com .com 75
27,047 thelocal.de .de 87
27,078 mdzol.com .com 61
27,105 unp.ac.id .id 76
27,108 marketingprofs.com .com 54
27,113 in3x.net .net 38
27,126 domserver.de .de 81
27,128 metapress.com .com 85
27,182 ultimahora.es .es 83
27,214 backloggd.com .com 70
27,243 themirror.com .com 47
27,248 oreillynet.com .com 94
27,256 amny.com .com 83
27,275 unenvironment.org .org 68
27,306 stylecaster.com .com 77
27,339 govexec.com .com 89
27,344 ga.de .de 80
27,354 munhwa.com .com 72
27,357 squareblogs.net .net 57
27,361 westfalen-blatt.de .de 81
27,401 derstandard.de .de 56
27,425 carbuzz.com .com 85
27,437 fox4news.com .com 85
27,467 wfmz.com .com 81
27,482 tug.org .org 44
27,551 latostadora.com .com 65
27,552 stuttgarter-nachrichten.de .de 71
27,608 cortexbid.com .com 72
27,660 pokelike.xyz .xyz 65
27,695 udayton.edu .edu 86
27,696 staradvertiser.com .com 84
27,700 weser-kurier.de .de 87
27,723 geek.com .com 38
27,756 beatstars.net .net 51
27,796 asiasociety.org .org 67
27,830 fox6now.com .com 85
27,833 apotheken-umschau.de .de 45
27,838 mtvuutiset.fi .fi 72
27,873 royallepage.ca .ca 75
27,906 usip.org .org 70
27,999 earth.com .com 80
28,003 footballant.com .com 75
28,021 sr.ht .ht 55
28,022 direct-book.com .com 45
28,038 topspeed.com .com 81
28,047 biodiversitylibrary.org .org 50
28,074 wvdme.com .com 49
28,079 apsense.com .com 52
28,085 thewom.it .it 89
28,096 mt.com .com 49
28,099 explained.today .today 42
28,116 psg.com .com 61
28,131 yabiladi.com .com 60
28,140 bdnews24.com .com 92
PreviousPage 8 of 15Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the GPTBot reference, the full census, and the JSON endpoint.