Frequently Asked Questions
What is IndexNow and how does it help with search indexing?
IndexNow is an open protocol that lets you notify search engines (Bing, Yandex, and others) when content changes. Instead of waiting for search engine crawlers to discover your updates, you push URLs directly, speeding up indexing from days or weeks to hours. You need to add a key file to your server to verify ownership.
What is a GEO score?
GEO (Generative Engine Optimization) score measures how likely AI search engines like ChatGPT, Claude, Gemini, and Perplexity are to discover, crawl, and cite your website. It factors in structured data completeness, AI crawler access (robots.txt), content clarity signals, and authority markers like Organization schema.
Why is GPTBot or ClaudeBot blocked on my website?
AI crawlers are blocked when your robots.txt contains a Disallow: / rule under User-agent: GPTBot (or ClaudeBot, PerplexityBot, etc.). This prevents those AI systems from reading your content and including it in their training data and search index. Remove the block if you want AI systems to be able to cite and reference your content.
How many URLs does the sitemap generator discover?
The tool crawls the homepage and extracts all internal links, discovering up to 100 unique URLs. It then filters out links blocked by your robots.txt to produce a clean, valid sitemap.xml ready for upload to your server and submission to Google Search Console.