Blocklist · OpenAI

Sites that block GPTBot

2,937 of the 29,991 domains we have measured, 10%, disallow gptbot at the site root in robots.txt. GPTBot collects content that may be used to train a model.

Every domain here has withheld its content from OpenAI's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,937 of 29,991 measured domains (10%) disallow gptbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block GPTBot", measured 2026-11-22. https://crawlcensus.com/blocked/gptbot

The list 2,937 domains

RankDomainTLDAI access score
45,876 nogizaka46.com .com 66
45,892 pvphq.com .com 43
45,902 fdfd.com .com 53
45,905 kob.com .com 84
45,971 wpp.com .com 64
45,997 katv.com .com 73
46,008 alkamitech.com .com 80
46,033 waptrick.com .com 65
46,045 mod.io .io 51
46,072 wirtualnemedia.pl .pl 84
46,076 bitgo.com .com 94
46,094 kibibe.com .com 35
46,104 desihub.tv .tv 82
46,106 guildlaunch.com .com 54
46,107 javxxhd.com .com 73
46,125 stuller.com .com 89
46,127 penn.museum .museum 81
46,128 svradv.com .com 46
46,134 interregeurope.eu .eu 60
46,137 powermag.com .com 86
46,154 airbnb.com.co .co 58
46,164 gazettelive.co.uk .uk 47
46,168 bizapedia.com .com 60
46,169 airbnb.mx .mx 58
46,175 frag-christel.de .de 57
46,181 gardenersworld.com .com 82
46,199 live5news.com .com 78
46,202 aqf.kz .kz 91
46,210 i3investor.com .com 53
46,217 letsrun.com .com 68
46,221 atlantanewsfirst.com .com 78
46,231 registerguard.com .com 66
46,250 openarchieven.nl .nl 87
46,274 lyrics.com .com 52
46,283 pcgamingwiki.com .com 70
46,290 benu.cz .cz 71
46,292 footboom1.com .com 67
46,301 redcafe.net .net 64
46,314 backpacker.com .com 78
46,339 consequenceofsound.net .net 85
46,342 pjstar.com .com 66
46,360 pnj.com .com 62
46,361 ceeol.com .com 66
46,409 are-we.co.uk .uk 79
46,458 voltairenet.org .org 65
46,482 wtkr.com .com 83
46,490 djmag.com .com 65
46,495 sowetan.co.za .za 82
46,496 veronalabs.com .com 83
46,502 adscientificindex.com .com 71
46,539 estar.jp .jp 62
46,554 bollyflix.free .free 57
46,560 raiplaysound.it .it 59
46,569 global-standard.org .org 88
46,575 zelenaya.net .net 61
46,579 bdsmlr.com .com 41
46,596 soccerpunter.com .com 72
46,599 deutschlandcard.de .de 65
46,635 wikihow.life .life 76
46,638 lunapic.com .com 68
46,671 edurev.in .in 89
46,691 drbokep18.com .com 71
46,713 dating.mobi .mobi 56
46,725 tuaw.com .com 87
46,742 live-shows.net .net 53
46,748 liveresult.ru .ru 64
46,753 grfc.ru .ru 50
46,765 plymouthherald.co.uk .uk 47
46,779 miarroba.com .com 68
46,788 londonist.com .com 72
46,793 quickanddirtytips.com .com 80
46,795 vinted.fi .fi 68
46,802 applicantpro.com .com 66
46,805 omroepwest.nl .nl 73
46,814 ripoffreport.com .com 88
46,820 kanaloco.jp .jp 76
46,836 unibz.it .it 72
46,844 symbl.cc .cc 71
46,849 kold.com .com 78
46,862 vinted.sk .sk 68
46,881 luluvid.com .com 51
46,910 vinted.bg .bg 68
46,918 examinerlive.co.uk .uk 47
46,923 alisweb.org .org 39
46,928 riba.org .org 59
46,949 schulferien.org .org 51
46,951 dday.it .it 88
46,990 fixya.com .com 43
46,994 ruslania.com .com 62
47,024 airbnb.co.kr .kr 59
47,029 lostarmour.info .info 51
47,039 sluurpy.com .com 89
47,065 lifehacker.jp .jp 89
47,070 posta.com.tr .tr 82
47,112 thenationaldesk.com .com 66
47,161 pickaweb.co.uk .uk 62
47,173 eurogamer.de .de 57
47,202 parts55.com .com 51
47,216 lr-online.de .de 72
47,243 alaphoid.com .com 57
47,259 rollingstone.de .de 87
47,281 ggjav.com .com 55
47,291 accelia.net .net 67
47,299 rtvdrenthe.nl .nl 73
47,347 mafra.cz .cz 62
47,355 cmsmasters.net .net 74
47,373 hentaienvy.com .com 65
47,374 f4wonline.com .com 64
47,393 networkofcare.org .org 53
47,394 autoscout24.fr .fr 86
47,424 harpersbazaar.de .de 89
47,428 wealthmanagement.com .com 81
47,441 scpr.org .org 79
47,516 novelcool.com .com 57
47,526 allgaeuer-zeitung.de .de 81
47,536 alaskasnewssource.com .com 78
47,546 thequietus.com .com 78
47,595 colnect.com .com 63
47,604 gazetaexpress.com .com 68
47,659 nationalgeographic.de .de 82
47,685 electrive.com .com 79
47,703 play3.de .de 64
47,709 fomos.kr .kr 51
47,741 salzburg24.at .at 85
47,796 topekalibraries.info .info 46
47,803 bushikaku.net .net 79
47,860 gpb.org .org 81
47,868 twitlonger.com .com 50
47,879 onefivenine.com .com 46
47,884 vcstar.com .com 62
47,916 transphoto.org .org 54
47,930 diariodecadiz.es .es 67
47,938 pornicom.com .com 73
47,947 numerade.com .com 85
47,948 theafricareport.com .com 55
47,969 sunjournal.com .com 72
48,004 ukclimbing.com .com 67
48,010 lfpress.com .com 87
48,024 huntingnet.com .com 74
48,025 museum.ru .ru 73
48,046 trinidadexpress.com .com 74
48,057 eastasiaforum.org .org 70
48,060 verifiedmarketreports.com .com 87
48,084 jurnalul.ro .ro 82
48,102 airbnb.com.ar .ar 58
48,199 oferteo.pl .pl 82
48,222 taiwanus.net .net 51
48,235 first-server.net .net 63
48,246 kushub.net .net 26
48,292 wellsky.com .com 74
48,298 pokebeach.com .com 66
48,352 denikn.cz .cz 75
48,369 newsnow.com .com 79
48,380 wsls.com .com 85
48,404 lesoleil.com .com 69
48,418 fireant.vn .vn 48
48,446 dohaxe.com .com 37
48,485 danatoto91.com .com 72
48,515 hurawatch.sx .sx 86
48,528 dorar.net .net 58
48,539 smsbower.app .app 76
48,544 darkhorse.com .com 77
48,550 argusleader.com .com 62
48,585 fairview.org .org 68
48,589 airbnb.com.sg .sg 58
48,613 theoutdoorstrader.com .com 52
48,626 hockey-reference.com .com 68
48,667 ozsuper.com .com 36
48,678 wgme.com .com 67
48,679 amasty.com .com 72
48,685 stylemepretty.com .com 92
48,724 one.co.il .il 83
48,752 fox11online.com .com 72
48,771 wwmt.com .com 63
48,777 mtv.fi .fi 76
48,782 bokepindo13.food .food 66
48,797 13wham.com .com 67
48,832 anoboy.xyz .xyz 78
48,833 alo-tech.com .com 77
48,853 vosgesmatin.fr .fr 82
48,858 otz.de .de 65
48,859 castro.fm .fm 67
48,860 adexchanger.com .com 83
48,876 chiangmaitourcenter.com .com 63
48,885 ventronchip.com .com 62
48,938 fox17online.com .com 85
48,949 unison.org.uk .uk 64
48,954 ebth.com .com 78
49,012 severstal.com .com 62
49,019 diyaudio.com .com 37
49,029 experts-exchange.com .com 68
49,037 bertrand.pt .pt 65
49,059 citypopulation.de .de 54
49,061 posfie.com .com 73
49,065 ingramcontent.com .com 69
49,081 idownloadblog.com .com 88
49,083 autoscout24.at .at 86
49,124 infolibre.es .es 86
49,126 scientific.net .net 52
49,192 therichest.com .com 84
PreviousPage 14 of 15Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the GPTBot reference, the full census, and the JSON endpoint.