AI crawlers and robots.txt: which bots to allow
GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot and Google-Extended each do a different job. What each bot does per its vendor and how to set robots.txt.
7 min read
Dravik blog
Straight answers for US teams of 20 to 500 people: what to automate, how to rank on Google, how to get cited by AI assistants, and how to stop losing leads.
Getting named and cited by ChatGPT, Perplexity, Gemini and AI Overviews.
GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot and Google-Extended each do a different job. What each bot does per its vendor and how to set robots.txt.
7 min read
How to appear in Google AI Overviews. What Google documents, what is only observed, how to structure pages for citation and how to measure the traffic.
6 min read
How to audit AI search visibility. Test buyer questions in ChatGPT, Perplexity, Gemini and AI Overviews, check crawler access and turn findings into fixes.
6 min read
How to get your business mentioned by ChatGPT. Let OpenAI's search crawler in, rank in search, write citable pages and build the presence ChatGPT draws on.
6 min read
Track AI search traffic with referral segments in GA4, ChatGPT's UTM tag, Search Console data for AI Overviews, and prompt checks for mentions without clicks.
7 min read
How to show up in Perplexity answers. Let PerplexityBot crawl your site, write answer-first pages, earn citations on trusted sources and track your visibility.
6 min read
AI engines quote passages that answer one question clearly, state specific facts and stand alone. A practical guide to writing pages ChatGPT and Google cite.
7 min read
llms.txt explained honestly. What the proposed standard is, how the file is structured, what is confirmed about AI engines using it, and when to add one.
6 min read
SEO wins rankings, AEO wins the direct answer, GEO wins citations in AI tools like ChatGPT. How the three differ, where they overlap, and what to do first.
7 min read
Which sources ChatGPT, Perplexity and Google AI Overviews lean on when they answer, and a practical plan for getting your company listed and cited there.
7 min read
Answer engine optimization (AEO) explained. How AI answer engines pick sources, how AEO differs from SEO, and the steps that make your pages easy to quote.
6 min read
Generative engine optimization (GEO) explained. Where the term came from, how AI engines build answers and the practical steps that get your brand included.
6 min read
Why brand mentions matter for AI search, how AI engines learn about companies, which mentions carry weight, and a practical plan to earn them without spam.
6 min read
Book a business audit
We look at your busywork, your Google rankings and how AI assistants describe your category, then hand you a prioritized plan.
Business audit, $19930 minute call plus a written plan
Find your leak