How to get cited by Claude
Learn how Claude retrieves web content, which Anthropic crawlers matter, how to build citation-worthy pages and how to measure brand visibility.

Claude can search the public web in supported experiences and provide citations. That creates an opportunity for publishers, but there is no guaranteed inclusion mechanism. The practical work has three layers: permit the access you want, create a source worth retrieving and prove whether Claude actually mentions or cites it.
Understand Anthropic's three crawler roles
Anthropic's official crawler documentation distinguishes three user agents:
| User agent | Documented purpose |
|---|---|
| ClaudeBot | collecting public content that may contribute to model development |
| Claude-SearchBot | indexing content for search optimization |
| Claude-User | retrieving content in response to a user's request |
This separation matters. A company may want search visibility and user-requested retrieval while opting out of future training collection. Do not use one blanket rule without understanding the tradeoff.
Audit access beyond robots.txt
An allowed user agent can still fail to retrieve the page. Test:
- status codes and redirect chains
- WAF, CDN and rate-limit behavior
- server-rendered main content
- canonical and
noindexdirectives - accidental blocks on scripts or data required to render the answer
- geographic or cookie barriers
Use server logs to distinguish a crawl problem from a content-selection problem. If the bot receives a clean 200 response but Claude never cites the page, publishing quality and authority become the next suspects.
Create a page Claude can cite precisely
Web-enabled answers need source material that supports specific statements. Make important facts visible, dated and attributable.
Key takeaways
- Open with a direct answer to the primary question
- Define the entity and category consistently
- Use tables for exact comparisons and limits
- Publish first-hand data with a reproducible method
- Link external claims to primary sources
- State limitations instead of hiding them
For commercial queries, cover the real decision. A product comparison should explain who each option is for, which capabilities were tested, what was excluded and when the information was verified.
Build a source architecture
One long page cannot be the best source for every claim. Create a small set of canonical destinations:
- a product page for capabilities and audience
- a pricing page for current plans and limits
- a methodology page for measurement definitions
- focused guides for common buyer problems
- documentation for implementation facts
Connect them with descriptive internal links. Avoid copying the same paragraphs across every page, because duplicate versions make the canonical source less obvious.
Add independent evidence
Claude may retrieve sources beyond the brand domain. Earn credible third-party coverage through customer stories, integrations, directories, industry research and expert reviews. Correct inaccurate listings and keep official profiles current.
The objective is corroboration, not mention volume. A specific review that explains a tested workflow is more useful than dozens of generic directory entries.
Measure Claude visibility correctly
Build a stable prompt set across discovery, comparison, objections and purchase intent. Record:
- whether web search or research was enabled
- whether the brand appeared
- whether Claude recommended or merely named it
- every citation URL
- competitors and their cited sources
- date, language, market and product surface
Anthropic says its Research experience can conduct multiple searches and return citations. That makes the exact mode part of the test context. A plain answer and a Research answer are not interchangeable observations.
Use the AI share of voice framework to compare competitors and the AI crawler guide to review access across providers. For a concise engine checklist, visit how to appear in Claude.
Frequently asked questions
- Which Anthropic crawler matters for search visibility?
- Anthropic documents Claude-SearchBot for search indexing and Claude-User for user-directed retrieval. ClaudeBot is associated with potential model training. Site owners should manage each user agent according to their policy goals.
- Does allowing ClaudeBot guarantee Claude citations?
- No. Crawl permission does not guarantee indexing, retrieval, citation or recommendation. It only determines whether a particular Anthropic bot may access the content for its documented purpose.
- Can a site allow Claude search but block model training?
- Anthropic documents separate user agents for model training, search indexing and user-directed retrieval. This lets a site express different rules for ClaudeBot, Claude-SearchBot and Claude-User.
- What content is most useful for Claude citations?
- Clear source pages with direct answers, verifiable facts, original evidence, current dates, primary references and a transparent methodology give Claude's web-enabled experiences stronger material to retrieve and cite.
Keep reading
- How to appear in Gemini answersImprove your brand's chances of being mentioned or linked in Gemini with clear entity facts, useful source pages, Google visibility and repeatable testing.
- How to refresh content for AI search citationsRefresh pages for AI search with current facts, stronger evidence, clearer intent coverage, better internal links and a controlled remeasurement process.