Blocklist · OpenAI

Sites that block GPTBot

2,937 of the 29,991 domains we have measured, 10%, disallow gptbot at the site root in robots.txt. GPTBot collects content that may be used to train a model.

Every domain here has withheld its content from OpenAI's training crawl. That is a separate decision from appearing in the operator's answers, which is governed by a different token.

The measurement

2,937 of 29,991 measured domains (10%) disallow gptbot at the site root in robots.txt. Every domain named on this page was fetched directly and its robots.txt parsed against RFC 9309; none of it is inferred from a third-party index.

Measured 2026-11-22 by direct request to every domain in the corpus. Method: how this is measured. Reuse under CC BY 4.0 with attribution.

Cite as: Crawl Census, "Sites that block GPTBot", measured 2026-11-22. https://crawlcensus.com/blocked/gptbot

The list 2,937 domains

RankDomainTLDAI access score
28,149 dotmed.com .com 72
28,165 cdromance.org .org 71
28,170 suedkurier.de .de 81
28,211 fox9.com .com 85
28,220 icecat.se .se 52
28,290 icecat.dk .dk 56
28,324 eurekamag.com .com 88
28,336 cargoagent.net .net 51
28,349 suamusica.com.br .br 77
28,361 core77.com .com 57
28,377 menuweb.menu .menu 69
28,383 lightreading.com .com 81
28,416 ticketmaster.nl .nl 85
28,438 360cities.net .net 49
28,480 lto.de .de 72
28,488 jsr.io .io 61
28,522 distance.to .to 57
28,540 mercadolibre.com.pe .pe 71
28,573 wpr.org .org 88
28,582 charentelibre.fr .fr 82
28,609 t-skirt.biz .biz 56
28,616 amzn.com .com 40
28,626 openfoodfacts.org .org 59
28,638 makuake.com .com 59
28,642 nachrichten.at .at 82
28,670 rapidtables.com .com 59
28,676 xforum.live .live 60
28,678 thenational.scot .scot 81
28,705 wellcomecollection.org .org 45
28,729 famelack.com .com 81
28,740 ctt.pt .pt 54
28,754 nekobt.to .to 54
28,757 federalnewsnetwork.com .com 86
28,767 mult-porno.team .team 56
28,789 berlingske.dk .dk 84
28,792 uesp.net .net 55
28,794 eastbaytimes.com .com 79
28,853 kutv.com .com 72
28,861 deeplearning.ai .ai 95
28,868 myvolumio.org .org 38
28,895 weatheronline.co.uk .uk 47
28,930 championcross.jp .jp 62
28,935 red-dot.org .org 74
28,950 acronymfinder.com .com 65
28,974 vinted.se .se 68
28,996 sebokep.vip .vip 78
29,001 completesports.com .com 88
29,011 fraserinstitute.org .org 51
29,031 threadreaderapp.com .com 59
29,045 tt.com .com 75
29,063 golzu.com .com 54
29,082 stan.store .store 53
29,100 turnto10.com .com 72
29,115 gp.se .se 78
29,121 pucsp.br .br 55
29,139 u-cursos.cl .cl 51
29,166 freakonomics.com .com 74
29,170 spinmagazine.com .com 79
29,172 moviesanywhere.com .com 76
29,178 motor-talk.de .de 70
29,259 fox5ny.com .com 87
29,260 b-cd.app .app 52
29,293 ceu.edu .edu 58
29,313 qbittorrent.org .org 50
29,315 taylorswift.com .com 89
29,327 vinted.hu .hu 86
29,340 bunjang.co.kr .kr 62
29,341 geometrylitepc.io .io 70
29,375 kotobank.jp .jp 64
29,390 kompas.id .id 64
29,447 artofproblemsolving.com .com 86
29,452 mstdn.social .social 51
29,478 cbs12.com .com 72
29,499 conjur.com.br .br 73
29,510 uvigo.es .es 56
29,513 mindtos.com .com 57
29,526 sex-studentki.guru .guru 57
29,549 freiepresse.de .de 86
29,551 lavoro.gov.it .it 63
29,553 hankookilbo.com .com 84
29,561 penso.com.br .br 90
29,562 therarbg.com .com 77
29,587 reprap.org .org 43
29,603 governing.com .com 87
29,634 westword.com .com 77
29,661 nn125.com .com 49
29,679 infosec.exchange .exchange 53
29,692 piliapp.com .com 65
29,700 gamessofun.com .com 50
29,701 thieme-connect.de .de 79
29,723 bookwalker.jp .jp 72
29,732 potaroo.net .net 65
29,746 partiful.com .com 72
29,752 hitc.com .com 72
29,821 providencejournal.com .com 73
29,884 techtudo.com.br .br 84
29,946 lareviewofbooks.org .org 57
29,980 lidovky.cz .cz 67
29,991 efhub.com .com 55
30,004 sfstandard.com .com 72
30,046 marketingweek.com .com 74
30,049 processing.org .org 57
30,052 lasprovincias.es .es 82
30,074 yugipedia.com .com 58
30,161 bostonmagazine.com .com 72
30,196 youngchampion.jp .jp 62
30,202 serializd.com .com 65
30,237 clarionledger.com .com 74
30,263 androidheadlines.com .com 68
30,273 centerblog.net .net 64
30,288 anycubic.com .com 68
30,301 qtoon.org .org 61
30,374 tu-clausthal.de .de 71
30,376 getxray.app .app 80
30,382 wook.pt .pt 57
30,387 bsc.es .es 37
30,393 ecode360.com .com 44
30,443 dobrzemieszkaj.pl .pl 61
30,457 fap-guru.name .name 56
30,470 turbo.cr .cr 54
30,472 bamgad7.com .com 66
30,500 routard.com .com 78
30,507 abc11.com .com 81
30,517 premioibest.com .com 70
30,571 everybodywiki.com .com 70
30,582 foxla.com .com 87
30,588 streamimdb.ru .ru 72
30,619 spectrumnews1.com .com 45
30,655 kfzteile24.de .de 78
30,678 xbato.co.uk .uk 73
30,681 siasat.com .com 84
30,698 nswpedia.com .com 75
30,703 wickedlocal.com .com 75
30,711 hi5.com .com 43
30,712 artforum.com .com 74
30,723 nporadio1.nl .nl 70
30,737 diariosur.es .es 82
30,738 fedpat.com.ar .ar 69
30,747 fox5dc.com .com 87
30,773 rheinpfalz.de .de 77
30,810 kentonline.co.uk .uk 76
30,860 wcpo.com .com 83
30,864 umms.org .org 76
30,915 sendtuna.com .com 45
30,921 service-online.su .su 65
30,928 bokepindoh.party .party 71
30,974 techadvisor.com .com 85
30,976 tablegame.ph .ph 39
30,986 commercialappeal.com .com 74
30,992 huffingtonpost.it .it 83
31,003 maxim.com .com 87
31,010 mult-porno.world .world 56
31,020 flexmls.com .com 89
31,023 phoenixnewtimes.com .com 71
31,032 howlongtobeat.com .com 49
31,057 linksbird.co .co 54
31,138 ideal.es .es 82
31,145 knowing-jesus.com .com 70
31,170 wxyz.com .com 85
31,176 edp24.co.uk .uk 79
31,195 birdlife.org .org 73
31,223 verpex.com .com 74
31,231 grupofpsinais.bet .bet 54
31,232 omicaso.org .org 58
31,252 forumactif.com .com 83
31,260 ktnv.com .com 83
31,282 vndb.org .org 60
31,284 publicdomainpictures.net .net 68
31,293 mcsweeneys.net .net 78
31,298 ticketmaster.com.au .au 86
31,320 lumendatabase.org .org 51
31,343 chita.ru .ru 84
31,352 sportsbusinessjournal.com .com 53
31,373 yugiyu2.com .com 56
31,381 coventrytelegraph.net .net 47
31,391 xn--l3cly6b0fd0c.net .net 76
31,392 batikloreng.online .online 76
31,425 ewtnnews.com .com 70
31,434 xxxtubevideos.click .click 61
31,441 yacenetv.com .com 83
31,443 saarbruecker-zeitung.de .de 82
31,445 kingviral.baby .baby 72
31,458 cricfytvap.net .net 78
31,475 tmll7.com .com 53
31,499 bolasport.com .com 76
31,533 krishitalk.com .com 56
31,549 lohud.com .com 74
31,552 codeweavers.com .com 64
31,554 currencyconverter.io .io 46
31,565 alexiskian.com .com 70
31,566 apinagadigital.com .com 64
31,571 dailyroutine.lifestyle .lifestyle 30
31,582 gamenila.com .com 56
31,591 lottosociety.com .com 75
31,593 me.game .game 36
31,598 pahindot.me .me 77
31,601 prodelibre.com.ar .ar 84
31,602 quickplayhub.in .in 56
31,623 videyli.co .co 26
31,628 xvidey.top .top 53
PreviousPage 9 of 15Next

Rank is the domain's position in the popularity list used to seed the corpus; a dash means it was scanned on request rather than seeded. Score is the site's overall AI access score, which blocking depresses but does not by itself determine.

Check a specific domain

See also the GPTBot reference, the full census, and the JSON endpoint.