Blocklist · OpenAI

Sites that block GPTBot

2,937 of the 29,991 domains we have measured, 10%, disallow gptbot at the site root in robots.txt. GPTBot collects content that may be used to train a model.

Every domain here has withheld its content from OpenAI's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,937 of 29,991 measured domains (10%) disallow gptbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block GPTBot", measured 2026-11-22. https://crawlcensus.com/blocked/gptbot

The list 2,937 domains

RankDomainTLDAI access score
21,155 grupostelegram.net .net 54
21,161 telemagazyn.pl .pl 81
21,162 psytests.org .org 69
21,166 holdgently.com .com 45
21,179 odibets.com .com 66
21,182 desiporn.one .one 52
21,192 technolife.com .com 90
21,231 epochtimes.com .com 85
21,248 happystove.com .com 58
21,263 pornobengala.com .com 72
21,267 seher.no .no 70
21,320 gazetatema.net .net 50
21,388 indiaxnxxx.com .com 67
21,428 plovdiv24.bg .bg 80
21,430 gamefa.com .com 95
21,431 thelocal.se .se 87
21,449 thisamericanlife.org .org 58
21,504 designspiration.com .com 48
21,549 callescort.org .org 70
21,553 azfamily.com .com 78
21,564 plotek.pl .pl 75
21,571 privatter.net .net 59
21,586 madison.com .com 80
21,602 becekku.com .com 81
21,678 hdmaal.la .la 55
21,692 wikidex.net .net 74
21,704 codeigniter.com .com 43
21,706 1x-chickenroad.com .com 44
21,707 khronos.org .org 68
21,736 slate.fr .fr 68
21,786 tamilprint62.art .art 55
21,792 mysiswaplace.my .my 52
21,816 footba11.co .co 61
21,823 desy.de .de 62
21,864 xvideosincesto.com .com 80
21,874 jadlog.com.br .br 62
21,875 dlpsgame.com .com 53
21,889 scoop.co.nz .nz 67
21,890 telerama.fr .fr 83
21,923 romspure.cc .cc 66
21,929 automobile.tn .tn 64
21,930 endnote.com .com 71
21,934 paradoxscans.com .com 76
21,950 fsolver.fr .fr 62
21,961 animesalt.link .link 70
21,976 deltaexploits.gg .gg 63
21,983 mypcards.com .com 76
22,002 uzmovi.net .net 78
22,006 bfd269.com .com 56
22,007 vg247.com .com 58
22,016 canva.in .in 86
22,028 distrowatch.com .com 44
22,031 news4jax.com .com 85
22,051 matchsimulator.com .com 70
22,114 onlybokep.com .com 84
22,128 niadd.com .com 55
22,149 airbnb.ca .ca 58
22,160 ntnews.com .com 92
22,193 vignanam.org .org 61
22,201 mmsgram.com .com 74
22,216 airliners.net .net 44
22,220 servg1.net .net 35
22,230 durationmedia.net .net 61
22,256 wsrv.nl .nl 55
22,272 geograph.org.uk .uk 84
22,277 tiamanhwa.com .com 69
22,279 ldtax.gov.bd .bd 52
22,294 thepornbang.com .com 60
22,295 pysznosci.pl .pl 87
22,309 vinted.be .be 68
22,365 petitesannonces.ch .ch 67
22,391 wgbh.org .org 83
22,428 gametracker.com .com 52
22,459 leofame.com .com 67
22,476 gruposwats.com .com 54
22,478 freakyza.co.za .za 76
22,479 ksat.com .com 85
22,503 49s.co.uk .uk 39
22,547 vipyonoslots.com .com 58
22,548 mydesihd.com .com 72
22,555 burgerpixel.net .net 56
22,557 foxaholic.com .com 58
22,569 happymod.tube .tube 76
22,583 videystream.store .store 53
22,623 mcall.com .com 78
22,626 medicaldaily.com .com 72
22,633 mynimeku.com .com 73
22,657 believesport.com .com 56
22,666 trevts.com .com 60
22,739 rxlist.com .com 80
22,740 zbzoub.com .com 58
22,771 movies4u.clinic .clinic 82
22,789 3seq.com .com 57
22,804 udea.edu.co .co 57
22,810 gperya.com .com 41
22,820 voir-anime.to .to 73
22,827 bestguiltypleasure.com .com 57
22,838 desimms.com.co .co 77
22,840 nbcsandiego.com .com 64
22,854 alexisbarcelona.com .com 66
22,867 fb77.one .one 50
22,869 videq-l.ink .ink 68
22,891 lolpol.com .com 60
22,923 2trk.info .info 55
22,938 congobet.net .net 45
22,941 ticketmaster.de .de 86
22,970 meujogodobicho.com.br .br 69
22,971 turskeserije.tv .tv 55
22,972 multimovies.study .study 64
22,976 gratiskryssord.no .no 79
22,987 syakouba.com .com 56
23,007 ogomovies1.com.pk .pk 82
23,044 adzuna.co.uk .uk 51
23,048 alexismiami.com .com 77
23,055 tiktokio.net .net 76
23,071 yomovies.business .business 70
23,073 ttks.tw .tw 49
23,081 satsitset.living .living 39
23,084 app.com .com 69
23,097 cinefreak.net .net 72
23,112 toto12express.org .org 69
23,122 sara777.com .com 89
23,123 1668manga.com .com 62
23,128 eauctionsindia.com .com 77
23,130 financemasterpro.com .com 79
23,133 javmyanmar.com .com 53
23,137 loteriasdehonduras.com .com 59
23,141 poizdato.net .net 60
23,143 samusar.com .com 46
23,144 sayhentai.cx .cx 72
23,154 rbb24.de .de 80
23,157 mlnba.fun .fun 54
23,164 bernama.com .com 75
23,167 dubmv.xyz .xyz 35
23,177 pyppo.com .com 55
23,185 hoathinh3d.st .st 78
23,237 bet261.mg .mg 45
23,244 pinayot.com .com 73
23,246 mobilejsr.com .com 54
23,264 olxsob.com .com 83
23,270 depedclub.com .com 80
23,274 pilipinay.tv .tv 82
23,282 goctruyentranhvui30.com .com 64
23,288 catbox.moe .moe 59
23,298 fuegodevida.com .com 58
23,317 amaterky.sk .sk 75
23,318 yoti.com .com 83
23,324 lunatogel78.com .com 75
23,328 pos4dtototogel84.com .com 70
23,334 xvideos.blog.br .br 91
23,343 tioeroge.com .com 76
23,355 pictbland.net .net 60
23,360 pinaybold.tv .tv 76
23,363 gazetadopovo.com.br .br 94
23,365 hometogel72.com .com 72
23,368 ssrmovies.luxe .luxe 59
23,378 winnipegfreepress.com .com 78
23,379 chotot.com .com 83
23,389 wftoon221.com .com 44
23,392 hotdesifuck.pro .pro 61
23,401 olxexp.com .com 77
23,402 vldeys.space .space 35
23,430 katu.com .com 73
23,442 playgamester.com .com 54
23,447 amnt-16d09m20y.com .com 35
23,452 cbunu.com .com 45
23,472 studyinsaudi.sa .sa 63
23,488 alexisboro.com .com 71
23,496 jps.go.cr .cr 33
23,519 vinahentai.club .club 84
23,545 alexissaddler.com .com 75
23,575 olxsos.com .com 83
23,582 alexismold.com .com 74
23,583 coloksgpaja.com .com 73
23,600 kawanpaitomember.com .com 58
23,613 nordbayern.de .de 81
23,630 olxtst.com .com 63
23,668 alexisverdugo.com .com 75
23,673 dingdongtogel91.com .com 74
23,689 3cr.game .game 60
23,699 alexisnemesis.com .com 71
23,700 alexisuro.com .com 71
23,701 badak178wind.live .live 47
23,703 olxpln.com .com 68
23,707 viideys.sbs .sbs 43
23,708 vildeey.space .space 43
23,715 1punrewudx.com .com 45
23,729 crea-tv.jp .jp 58
23,752 in.game .game 37
23,754 inviv.top .top 36
23,759 kingsofsatta.com .com 59
23,762 ldidyg.com .com 44
23,773 naychje.com .com 44
23,782 playindialottery.com .com 44
23,788 satta-king-live.com .com 76
23,790 sattamatka.email .email 84
23,795 shillongteergrounds.in .in 81
23,798 spinjeet365.com .com 36
23,846 dailypost.ng .ng 83
23,940 pirateswap.com .com 78
PreviousPage 7 of 15Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the GPTBot reference, the full census, and the JSON endpoint.