Free tool · New
AI visibility checker
Can ChatGPT, Claude, Perplexity and Google's AI Overviews read your website? Find out what blocks them, crawler by crawler, and how to fix it.
Crawler by crawler
Recommended robots.txt section
Add this above your existing rules, and keep your Sitemap line.
Vigocrest fixes JavaScript-only pages, adds structured data, writes answer-friendly content and checks your Cloudflare or hosting settings, at a fixed price.
Why use it
People now ask AI before they search
- More customers ask ChatGPT, Perplexity or Google's AI Overviews "best tutor near me" or "which CA in Jayanagar". If AI can't read your site, you're left out of the answer.
- Many sites block AI crawlers by accident: an old robots.txt, a Cloudflare setting or a JavaScript-only website. This finds those in seconds.
- AI companies use separate crawlers for answering questions and for training. You can stay visible in AI answers and still opt out of training. The checker shows each one.
- It tells you exactly what to change, including a ready-to-paste robots.txt section.
Where to use it
Run it on
- Your homepage, service pages and pricing page: the pages you want AI to quote.
- Before and after a website redesign or a move to a new platform (React, Wix, Shopify, WordPress themes).
- After turning on a CDN or security product like Cloudflare, which may block AI bots by default.
- Client websites, if you're an agency or freelancer: a quick, visible audit to start a conversation.
Questions
Frequently asked questions
What is AI visibility?
Whether AI assistants and AI search (ChatGPT search, Claude, Perplexity, Google AI Overviews, Microsoft Copilot) can reach your pages, read the text and understand who you are, so they can mention and link to you in answers.
What's the difference between AI search crawlers and AI training crawlers?
Search crawlers (such as OAI-SearchBot, Claude-SearchBot and PerplexityBot) fetch pages so the AI can answer questions and cite you today. Training crawlers (such as GPTBot, ClaudeBot and Google-Extended) collect text to train future models. They are controlled separately in robots.txt, so you can allow one and block the other.
Should I block AI training crawlers?
It's your choice. Blocking them keeps your content out of future model training. Allowing them may help AI models learn about your brand. Blocking training crawlers does not remove you from AI search answers, as long as the search crawlers are allowed.
Why does JavaScript matter?
Most AI crawlers read the HTML your server sends and don't run JavaScript. If your site only shows content after JavaScript runs (common with React or app-style builders), AI sees an almost empty page. Pre-rendering or server-side rendering fixes this.
What is structured data and why does AI need it?
Structured data (JSON-LD) is a small block of code that states facts like your business name, address, phone, opening hours and products in a format machines read reliably. It helps AI and search engines describe you correctly. Make it with our free schema markup generator.
Does llms.txt help?
Possibly a little. llms.txt is a proposed file that guides AI tools to your most useful pages. A few AI tools and coding assistants read it, but Google has said it doesn't use it. It's optional, so treat it as a bonus, not a fix.
Does a good score guarantee AI will recommend me?
No. The checker makes sure AI can reach and understand your site. Whether AI recommends you also depends on your reputation, reviews, mentions on other sites and how well your content answers questions.
Built by Vigocrest Ventures
Need more than a free tool?
We design and build websites, web apps and AI products end to end, from Bangalore. Fixed written scope, and you own the code.