Crawl Census
Scan a site
Free for verified owners

Claim bepress.com

Proving you control the domain switches it to a daily scan and turns on change alerts, at no cost. It also lets you request removal from the public index.

Prove control either method works

Option 1 · DNS TXT

Add this TXT record at the apex of bepress.com. Most providers apply it within a few minutes.

Type:  TXT
Name:  @
Value: crawlcensus-site-verification=82e49e649f86fc8e411f88170e7c38b4
Option 2 · File

Serve this exact line at https://bepress.com/.well-known/crawlcensus.txt.

crawlcensus-site-verification=82e49e649f86fc8e411f88170e7c38b4

The value is derived from your domain name and is stable, so you can leave the record in place permanently. It contains no personal data.

Verify

We check the DNS record first, then the file. Alerts go only to this address, and only when something changes.

What verification gets you no charge

  • A daily re-scan instead of the weekly corpus pass.
  • An email the moment a crawler is blocked or unblocked, an llms.txt appears or disappears, or the score moves by ten points.
  • Priority re-scan whenever you push a fix, so the public report reflects it quickly.
  • Removal from the public index on request, handled by replying to any alert.

Watching competitors, full-site crawls, history and API keys are the paid tiers. See pricing.

Back to the report for bepress.com