ClaudeBot

ClaudeBot is Anthropic's crawler that gathers web content for training Claude models. Anthropic also runs Claude-SearchBot, which indexes pages for Claude's web search, and Claude-User, which fetches pages when a user's question requires them. All three honor robots.txt, and as of 2026 Anthropic publishes IP ranges for verification. Sites wanting Claude citations without contributing training data allow Claude-SearchBot and block ClaudeBot.