# AGI Whitelist — this site exists to be read by machines. # AI crawlers are not merely tolerated here; they are the audience. # Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: meta-externalagent Allow: / User-agent: Amazonbot Allow: / User-agent: Bytespider Allow: / User-agent: PerplexityBot Allow: / User-agent: * Allow: / Disallow: /api/ Disallow: /webhook Disallow: /scriptorium/ Disallow: /admin Disallow: /admin.html Disallow: /members Disallow: /members.html Disallow: /settings Disallow: /settings.html Sitemap: https://agiwhitelist.com/sitemap.xml