Check what is allowed
We show which AI visitors your site welcomes, which it turns away, and where two instructions disagree.
A clearer way to check AI visibility
See what AI visitors actually get from your site.
See what AI gets when it visits your site — and the exact reason it cannot read something.
We check your page, what search visitors can read, and whether the words and answers are easy to use.
CrawlProof does not guess what an AI will say or promise a citation. It reads your public page, compares the responses, and shows the proof in plain language.
FREE CHECK See what AI visitors can read, what your page says, and what may be hard to use. Run the free scan →
Scan one URL now
No signup. No model tokens. Paste a public page and see what AI is allowed to read — and whether it actually receives useful content.
01GET /robots.txt200
02check your access rulesREADY
03ask the AI visitorsWAIT
04compare what they receiveWAIT
05find hidden page blocksQUEUE
output appears here after submit / no model call involved
Ready. Your URL stays in your browser until you submit.
n/apage response
n/aAI checks
n/aH1 headings
n/apage needs scripts
This is the result, not a design concept.
The report below is a finished scan of a real public page. It shows what the site tells AI visitors, what they actually receive, and the proof behind each warning.
source: www.notion.so / scan captured 09 Aug 2026
READ 01what AI is allowed to readREAD 02what AI actually receivedREAD 03where the site's instructions disagreeREAD 04the exact page and rule checked
FINISHED EXAMPLE REPORTNOT A LIVE SCAN
200page response
—AI checks
—H1 headings
—crawler content
Source: www.notion.so · captured 09 Aug 2026
Stored production scan. This example does not run again when the page loads.
The common collateral damage is simpler.
In our measured sample, sites that blocked AI often blocked search and training together. CrawlProof shows the cost plainly: you blocked AI training and also removed yourself from AI search — then gives you the configuration that keeps search access while staying out of training.
OPENAI / entirely blocked incl OAI-SearchBot: 8/75
ANTHROPIC / entirely blocked: 13/75
TRAINING ONLY / OpenAI: 10/75 · Anthropic: 9/75
75 sites · root-path robots sample · CrawlProof measurement · not a web-wide prevalence estimate.
n/adomains scanned by CrawlProof
n/areturned a block or challenge to at least one crawler
n/acompleted purchases, counted from Dodo fulfilment records
Make your page easier to use.
Plain answers about what your site says, what AI visitors receive, and what a buyer can understand quickly.
Check what arrived
We compare the page a normal visitor sees with the page an AI-style request receives.
Read the page like a buyer
We look for clear answers, useful headings, real text, structured data, and sections that make sense on their own.
Give you the proof
Each result points to the page, response, or instruction behind it. No guessed score and no promise of a ranking.
HONEST LIMITATION: we test a request from CrawlProof, not a verified crawler from a vendor's network. A refusal proves what our request received, not what every real AI visitor receives.
What you actually get.
Small checks, assembled into a report an owner or agency can explain to a client.
ChatGPT is being told your page is empty
We compare the page a browser sees with the page each crawler receives. A 200 response can still be an empty app shell.
- content size and headings
- title and structured data
same URL
real difference
Your robots file and your server give opposite orders
We join robots rules, noindex headers, page tags, canonicals, sitemaps, and redirects instead of listing them separately.
page tags / canonical
sitemap / redirect
Find the blocks robots.txt cannot show
We also check page tags and server headers that can say “do not list this page” even when the main rules look fine.
page tag
hidden noindex
Catch the empty app shell
A page can look fine in a browser but send almost nothing to a text-only visitor. We show that difference instead of calling it healthy.
page size
real difference
Questions people actually ask
We flag headings that sound like slogans and show page-derived prompt ideas. They come from your words; they are not predictions of what AI will say.
page-derived prompts
not predictions
Sections that make sense alone
We look for short passages that start with “it”, “this”, or “they” and may lose their meaning when copied without the rest of the page.
clear subjects
extractable text
Structured data and trust signals
We check useful page types, names, dates, sources, numbers, definitions, and comparisons without claiming they guarantee visibility.
dates / sources
consistent name
Find the sites that need help
Agency scans check a list of client or prospect sites, sort the real issues first, and give you a report you can hand to a client.
severity first
client-ready report
“20 minutes per client per week manually Googling their brand in ChatGPT and Perplexity, screenshotting results, and pasting them into a Google Doc. That is not a workflow. That is desperation.” — Freelance SEO managing nine client sites, Indie Hackers user report; source
Same anxiety. Different bill.
These are the settled comparison figures from our research. Third-party captures remain labelled as such.
| Tool | Price observed | What it does | What CrawlProof does instead |
|---|---|---|---|
| Profound | $99–$399/mo | LLM visibility and citation tracking | One-time technical evidence, no model inference |
| Peec AI | ~$95+/mo, third-party capture | AI search monitoring | AI visitor access and page-content checks |
| AthenaHQ | ~$295/mo, third-party capture | Answer-engine analytics | Robots and HTTP evidence without a subscription |
| Semrush AI Visibility Toolkit | $99/mo per domain | AI visibility and an AI-readiness site audit | Focused deterministic audit, $69 once |
| Ahrefs Brand Radar | from $199/mo | Brand visibility in AI answers | No citation tracking, no recurring model cost |
| ZeroRank AI | $89 LTD observed | AI-search citation monitoring | Technical half of GEO, not citation monitoring |
| CrawlProof Solo | $69 once | AI access checks, content differences, hidden blocks, fix files | What they do that we don't: citation tracking. |
Free with purchase. Built, not promised.
AI Crawler Access Playbook
A practical guide to keeping search access while controlling training. Delivered through the activation page after purchase.
Crawler Agent Kit
Working code that logs real crawler hits on your site, checks published IP ranges where possible, and includes a CLI and fix-file generator.
The agency bonus stack
Client explainer, vendor reference, prospecting scripts, log parser, CI kit, runnable robots tests, CDN/WAF checklists, and a robots diff viewer. No ranking or citation promises.
Lifetime means no quiet downgrade.
No credits. No usage metering. No tier remapping. No feature moved behind a later paywall. You get the current deterministic CrawlProof product and its paid capabilities for the lifetime of the product; third-party crawler behavior and future external services remain outside our control.
A note from the founder
I built CrawlProof around the part of GEO that can be honest as a lifetime product: fetching public pages, comparing crawler purpose, and reporting deterministic evidence. No metered LLM calls means the product does not quietly become a credit meter.
FIELD NOTEOne-time access keeps the evidence legible: no recurring visibility bill, no mystery score.60 DAY / DODO MoR
60-day money-back guarantee through the merchant-of-record checkout.
60-day money-back guarantee through the merchant-of-record checkout.
Start with the evidence.
Recurring tools meter answers and visits
What you're getting
Clear page and access checksincluded
Fix files, compare, and bulk accesspaid tier
Solo / 50 pages$69 once
Agency / 50 client sites$149 once
$69
Solo, one-time payment
Solo is $69 once, with no credits or recurring metering.
200 founder licences leftFounder allocation and price window remain live.Founder price timer: 31:00
- 50-page cap, all free scanner checks
- fix files, competitor compare, bulk scanning
- optional buyer-key checks; you pay the provider
- bonuses delivered on the activation page
Questions worth asking before you buy.
No inflated promise, no fake customer wall, no mystery score.
Isn't this free elsewhere?
Yes. Several free tools check more AI visitors than we do. We show what the result means, point to the exact rule or page tag, give you the corrected file, and let paid users compare and scan a client portfolio. You keep the report instead of getting an unexplained score.
Will this get me cited by ChatGPT?
No. CrawlProof cannot promise citations. Schema's causal effect is unsettled, and answer engines change. We show whether a supplied request was allowed, blocked, challenged, or served an almost-empty page. That is evidence for remediation, not a citation guarantee.
Does llms.txt make me visible?
We can report whether it exists, but adoption by major providers is unconfirmed. It is not the headline feature and we do not claim it is a proven ranking lever.
Does a refusal prove every real AI visitor is blocked?
No. We test a request from CrawlProof, not a verified crawler from the vendor's network. Treat it as strong proof of what our request received, then use the report to find the rule or server setting responsible.
What does lifetime mean?
No credits, no metering, no tier remapping, and no current feature moved behind a later paywall. It covers the current deterministic CrawlProof product for its lifetime; it cannot control third-party crawler behavior or promise every future feature forever.
How does the refund work?
60 days, stated plainly. If the report is not useful for your site, request a refund within 60 days through the merchant-of-record checkout.
60-day money-back guaranteeMerchant of Record: Dodo PaymentsOne-time checkout, not a subscriptionNo LLM inference in the scan