Unburied

Can AI Assistants Read Your Site? Free AI Crawler Check

See whether ChatGPT, Claude, Perplexity, Gemini and Google's AI can read your site, what blocking each crawler does, and whether your pages need JavaScript to show their text.

Search crawlers and training crawlers are different

Each AI company runs separate crawlers. Some build the index its assistant searches when answering, some fetch a page because someone asked about it, and some only collect training data. Blocking a training crawler such as GPTBot or ClaudeBot opts you out of training but leaves you in the answers. Blocking OAI-SearchBot, Claude-SearchBot or PerplexityBot removes you from those answers. Blocking Googlebot removes you from Google entirely, AI Overviews included.

Why JavaScript matters

Google renders JavaScript. The crawlers behind ChatGPT, Claude and Perplexity download it but don't run it, so text that only appears after scripts run is invisible to them. Sites built as single-page apps often look empty to AI.

How this check works

We read your robots.txt and your home page once, as UnburiedBot, and apply each crawler's rules as its operator documents them. We never pretend to be another company's crawler, so a firewall that blocks AI bots by name (such as Cloudflare's “Block AI bots”) won't show up here unless your site is behind it.

Unburied runs this for your whole site every week

It also tracks how often AI assistants mention you, finds the fixes worth making, and measures each one against pages it didn't touch.

Try the demo