AI search optimization is the practice of getting a brand mentioned, cited, and recommended in the answers that ChatGPT, Gemini, Claude, and Perplexity give to buyers.
The method has 4 steps: open each platform's search crawler to your pages, describe your company the same way on every site that covers it, publish pages that answer buyer questions in quotable passages, and rerun a fixed set of buyer prompts every month to see what changed.
Each assistant has its own crawler rules: OpenAI runs OAI-SearchBot for ChatGPT, Google grounds Gemini Apps in its Search index, Anthropic indexes pages for Claude with Claude-SearchBot, and Perplexity uses PerplexityBot.
All 4 tell site owners to manage access through robots.txt, the Robots Exclusion Protocol that the Internet Engineering Task Force (IETF) published as Request for Comments (RFC) 9309.
The discipline, also called answer engine optimization (AEO) or generative engine optimization (GEO), exists because more business-to-business (B2B) buyers in software as a service (SaaS), fintech, and infrastructure now ask artificial intelligence (AI) assistants which vendors to shortlist.
Key Takeaways
ChatGPT, Gemini, Claude, and Perplexity each control search access through their own crawler or index, so allowing 1 bot in robots.txt does nothing for the other 3.
OpenAI and Anthropic document their training crawlers (GPTBot and ClaudeBot) separately from their search crawlers (OAI-SearchBot and Claude-SearchBot), so a site can opt out of model training and still appear in search answers.
Google-Extended is the exception: blocking it to opt out of Gemini training also stops Gemini Apps from grounding answers in your pages.
Pew Research Center found that Google users clicked a traditional search result in 8% of visits when an artificial intelligence (AI) summary appeared, compared with 15% of visits when none did.
Search engine optimization (SEO) still underpins AI visibility, since Google requires pages to be indexed and snippet-eligible before they can appear in AI Overviews or AI Mode.
A fixed set of buyer prompts, rerun monthly with mentions, citations, and recommendations logged separately, shows whether a brand is named and whether it is actually recommended.
Why Does AI Search Optimization Matter for B2B Companies?
Buyers increasingly read a generated answer before any vendor's website, and the brands named in it reach the shortlist first. Pew Research Center's click data and OpenAI's usage figures show the shift's scale.
See How Few Searchers Click Past the Answer
A Pew Research Center study tracked the Google searches of 900 adults in the United States for 1 month. When an AI summary appeared, users clicked a traditional search result in 8% of visits, against 15% when no summary appeared, and links inside the summary drew a click in 1% of visits. A page can win at search engine optimization (SEO) and still sit beneath an answer that already names 3 competitors.
Plan for 4 Assistants With Separate Audiences
OpenAI's own figures put ChatGPT's reach at 1.2 billion people a week, and Gemini, Claude, and Perplexity add audiences of their own. Each retrieves from a different source pool, so one can recommend you while another leaves you out. An AI search strategy that tests only ChatGPT misses those gaps.
How Do ChatGPT, Gemini, Claude, and Perplexity Find Their Sources?
Each assistant pulls live web content through its own crawler or index, and each vendor documents which crawler decides whether your pages appear. The table condenses that documentation from all 4 vendors.
Compare the 4 Platforms Side by Side
Use the table as your web team's access checklist. Every cell comes from the vendor's own crawler or help documentation.
Platform | Where live answers get web content | Crawler that controls search inclusion | Training crawler you can block separately | How sources appear |
|---|---|---|---|---|
ChatGPT (OpenAI) | ChatGPT search, which rewrites prompts into 1 or more queries and may send them to partner search providers | OAI-SearchBot | GPTBot | Citations in the answer, plus a Sources panel |
Gemini (Google) | The Google Search index, used to ground answers in Gemini Apps | Googlebot, plus Google-Extended for Gemini Apps grounding | Google-Extended, which also covers grounding | A Sources button inline or below the answer |
Claude (Anthropic) | Claude's web search, indexed by Claude-SearchBot, with Claude-User fetching pages on request | Claude-SearchBot, plus Claude-User for live fetches | ClaudeBot | Citations in every web search response |
Perplexity | Live search, with PerplexityBot surfacing and linking sites | PerplexityBot, plus Perplexity-User for live visits | None listed, since PerplexityBot is not used for foundation model training | Links to the pages visited for the answer |
Treat Search, Live Fetching, and Training as Separate Switches
The table separates 3 controls: indexing for search, fetching a page when a user asks, and collecting training content. OpenAI lets a site allow OAI-SearchBot while blocking GPTBot, and Anthropic separates Claude-SearchBot from ClaudeBot the same way.
Gemini is the exception. Google says Google-Extended governs both Gemini training and the grounding of Gemini Apps answers in Search content, without affecting Google Search, so blocking it removes your pages from what Gemini Apps can use.
What Does Each Platform Need From Your Website?
Each platform needs crawl access through its own bot, and each gives you a way to confirm it works. Here is what to check for each assistant.
ChatGPT: Allow OAI-SearchBot in Your Crawl and Firewall Rules
To optimize for ChatGPT, meet the 2 requirements in OpenAI's help documentation: robots.txt must allow OAI-SearchBot, and your host or content delivery network (CDN) must accept traffic from OpenAI's published search bot internet protocol (IP) addresses. The second fails quietly, since a bot-protection rule can block the crawler while robots.txt looks fine.
Search yourdomain.com/robots.txt for OAI-SearchBot and any catch-all Disallow rule, and ask whoever runs your CDN whether OpenAI's addresses get through. OpenAI says changes take about 24 hours to register, and our guide to checking ChatGPT access covers the full test.
Gemini: Stay Indexed and Snippet-Eligible in Google Search
Gemini SEO starts with ordinary Google eligibility, because Gemini Apps ground answers in the Google Search index. Google's documentation on AI features says a page must be indexed and eligible to show a snippet, with no additional technical requirements or special structured data for AI Overviews and AI Mode.
In Google Search Console, confirm key pages are indexed, free of nosnippet tags, and open to Googlebot. Make any Google-Extended block a deliberate decision, and read how AI Overviews work for Google's own source selection.
Claude: Let Claude-SearchBot and Claude-User Reach Your Pages
Claude search optimization starts with Anthropic's 3 bots. Claude-SearchBot indexes content for Claude's search results, Claude-User fetches pages when someone asks Claude a question, and ClaudeBot collects training content. Anthropic warns that blocking either of the first 2 may reduce visibility in user search results.
Check robots.txt for rules naming either search bot and for a catch-all User-agent: * block. Henry W., founder of our client Clvr, wrote in his testimonial: "Within 6 weeks we were showing up in Perplexity and Claude for LinkedIn ghostwriting queries."
Perplexity: Clear PerplexityBot and Perplexity-User at the Firewall
To optimize for Perplexity, start with its crawler documentation. PerplexityBot surfaces and links websites in Perplexity search results and isn't used for foundation model training. Perplexity-User visits a page when a user asks a question and generally ignores robots.txt, because a person requested the visit.
Perplexity recommends allowing PerplexityBot in robots.txt and allowing both agents in your web application firewall by user agent and IP range. It says changes can take up to 24 hours to apply.
Which Entity Signals Help AI Assistants Recognize Your Company?
Entity signals are the consistent facts about your company across your site and third-party sources: name, category, products, leadership, location, and buyers served. When they agree everywhere, an assistant can match a buyer's question to your company with less room for error.
Write One Company Description and Reuse It Everywhere
Draft a 2-sentence description naming your category, buyer, and main product, then reuse it on your About page, LinkedIn page, review profiles, directories, and press boilerplate. Any Organization structured data should match the visible text, per Google's guidance.
Then ask each assistant what your company is known for, who it suits, and who should look elsewhere, citing sources. Correct each wrong fact at the cited source and on your own pages.
Earn Coverage on the Sites Assistants Already Cite
A few third-party domains appear again and again in AI answers. In the same Pew study, Wikipedia, YouTube, and Reddit were the most cited sources in Google's AI summaries, together making up 15% of the sources shown.
Find your category's equivalents by asking each platform which sites it trusts for your category and logging every domain your prompt tests cite. Domains that repeat across platforms go to the top of your outreach plan.
Which Content Formats Earn Citations in AI Answers?
Pages that answer a buyer's question right under a clear heading, back it with specific facts, and compare options fairly give assistants passages they can quote as written. Start with formats closest to a purchase decision.
Answer the Question Under Every Heading
Write each heading as the question a buyer would type, answer it in the first 1 to 2 sentences, then expand. Passages that make sense lifted out of the page give assistants something to quote and skimming buyers a fast answer.
To test a page, paste a single section into Claude or ChatGPT and ask it to answer the heading's question from that text alone. A vague or wrong reply means the section needs a clearer first sentence or a missing fact.
Build the Pages Buyers Use to Compare Vendors
Buyers who type a shortlist prompt want options they can weigh, so build the pages that let an assistant compare you fairly:
Comparison pages that say where a competitor fits better, and where you do
Alternatives pages for the competitors your buyers already know
A pricing page with real numbers, or at least your pricing model
Use-case and industry pages that name the buyer, the problem, and the outcome
A fit statement covering who your product suits and who should look elsewhere
Publish Numbers Other Sites Can Quote
Specific, sourced numbers give journalists, analysts, and assistants something to cite, from case studies with before-and-after figures to benchmarks and survey results. Give every number its period and source.
Our fintech client Opal Spend started with 4 indexed pages and no blog. We rebuilt the technical foundation, published 60+ articles mapped to buyer prompts, and launched 13+ bottom-of-funnel pages. Opal's tracked AI share of voice rose from 3.9% to 11.2%, and within 90 days AI search was producing 10+ inbound demos a month.
How Do You Measure AI Search Visibility Each Month?
Run the same buyer prompts on the same platforms every month and log what each answer says about you. Rank trackers miss this, since a buyer can read your name in an answer and never click.
Lock a Set of Buyer Prompts Before You Start
Write 30 to 50 prompts real buyers would type while learning about the problem, comparing vendors, and choosing one. Keep most unbranded to see whether assistants suggest you to buyers who don't know your name, and keep the set fixed so each month compares like with like. Our guide to researching buyer prompts covers sourcing.
Log Mentions, Citations, and Recommendations Separately
For each prompt and platform, record the date, whether your brand was mentioned, cited, or recommended, who was recommended instead, and which pages were cited. Use a new chat for every run, signed out where possible, and repeat prompts a few times, since answers shift.
Weight the recommendation column most heavily, since it mirrors the shortlist a buyer acts on. Our article on earning B2B citations explains why mentions and citations can move independently.
Connect AI Visibility to Pipeline
Create a custom channel group in Google Analytics 4 (GA4) for referrals from chatgpt.com, gemini.google.com, claude.ai, and perplexity.ai. Ask "How did you hear about us?" on demo and contact forms.
Google counts clicks from AI Overviews and AI Mode within the overall Web search data in Search Console, so they won't appear as a separate AI source. Your monthly AI search marketing report should show prompt results, AI referrals, and self-reported lead sources side by side.
Get Your Brand Into More AI Answers
Windgrove runs this playbook for B2B companies in SaaS, fintech, infrastructure, and technology, and we handle the execution, from technical fixes to content, authority building, and reporting. You can start free or hand us the full program.
Start Free or Hand Us the Full Program
Our free AI Visibility Audit shows where your brand appears in AI answers, where competitors lead, which buyer queries you're missing, and what to fix first.
Managed programs start at $4,200 a month with 50 tracked buyer prompts plus up to 16 content assets, 3 to 5 authority links, and 1 to 2 public relations (PR) placements a month, and your team typically needs 1 to 2 hours a week.
Each program opens with a 90-day initial term and guarantees a minimum lift in unbranded AI visibility within that window, from 20% on the entry tier against an agreed day-one baseline; if we miss it, we keep working for free until we hit it.
The Windgrove Edge, our conversion and attribution system, is a $2,500 monthly add-on that comes included in the top tier, and you can compare all 3 tiers before booking a call.
Frequently Asked Questions (FAQs)
These questions come up once a team starts testing its own visibility. Each answer stands alone, so you can forward one to a colleague.
How Long Before a Brand Appears in AI Answers?
Timing depends on your starting point, category, and existing third-party coverage. OpenAI and Perplexity say crawler changes take effect within about 24 hours, while Google says recrawling can take days to months. Windgrove measures its visibility guarantee at 90 days, and a client reported appearing in Perplexity and Claude within 6 weeks.
Do We Still Need SEO If We Optimize for AI Answers?
Yes. Google says pages must be indexed and eligible for a snippet to appear in AI Overviews and AI Mode, and Gemini Apps ground answers in that same Search index. ChatGPT search can also query partner search providers, so crawlable, indexed pages are the base for both search engine optimization (SEO) and AI visibility.
Should We Block GPTBot, ClaudeBot, or Google-Extended?
Block them only to keep your content out of model training. OpenAI and Anthropic say GPTBot and ClaudeBot serve training, so blocking them leaves OAI-SearchBot and Claude-SearchBot free to index you. Google-Extended differs because it also controls whether Gemini Apps can ground answers in your content, so blocking it costs Gemini visibility.
Which Platform Should a B2B Company Prioritize First?
Start with the assistants your buyers already use, which sales calls and the "How did you hear about us?" answers on your forms can reveal. ChatGPT reaches 1.2 billion people a week by OpenAI's count, and Gemini grounds its answers in Google Search. Track all 4, then shift effort toward those sending qualified leads.
What Does It Cost to Hire Windgrove for This Work?
The AI Visibility Audit is free. Windgrove's managed programs cost $4,200, $6,400, or $12,500 a month (Claim Your Ground, Hunt the Leaders, and Take the Throne), each with a 90-day initial term and a minimum visibility guarantee. The Windgrove Edge conversion add-on costs $2,500 a month and is included in Take the Throne.

