TOOL EVIDENCE CARD
CrawlerCheck
Checks robots.txt, meta robots and X-Robots-Tag access for search and AI crawlers.
Best fitTechnical access diagnosis
Price / accessFree
EnginesGooglebot · GPTBot · ClaudeBot · PerplexityBot · 169 crawlers
WorkflowTechnical readiness
What is verified
Checks robots.txt, meta robots and X-Robots-Tag access for search and AI crawlers. The public source confirms the capability and the linked plan or product context; it does not establish an outcome guarantee.
Limitations to keep visible
Allowed access does not prove indexing or citation; safety scores are methodology outputs.
Official sources
Use the product page to understand the job and the pricing page to confirm the current plan. Prices, engines and limits should be rechecked after 30 days.