User-Agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Disallow: /admin Disallow: /admin/ Disallow: /api/ Disallow: /account Disallow: /settings # /home (dashboard) is removed from Google via page-level noindex metadata, # NOT via robots.txt. Disallowing it would (a) prefix-match every /home-* # public landing page (/home-business-ideas etc.) and (b) prevent Googlebot # from ever crawling /home to see the noindex header — robots.txt blocks # crawling but doesn't deindex. See app/(app)/home/page.tsx metadata.robots. User-Agent: GPTBot Allow: / User-Agent: OAI-SearchBot Allow: / User-Agent: ChatGPT-User Allow: / User-Agent: ClaudeBot Allow: / User-Agent: Claude-Web Allow: / User-Agent: anthropic-ai Allow: / User-Agent: PerplexityBot Allow: / User-Agent: Perplexity-User Allow: / User-Agent: Google-Extended Allow: / User-Agent: Bingbot Allow: / User-Agent: DuckDuckBot Allow: / User-Agent: Applebot Allow: / User-Agent: Applebot-Extended Allow: / User-Agent: Amazonbot Allow: / User-Agent: Meta-ExternalAgent Allow: / User-Agent: CCBot Allow: / Host: https://businessideasdb.com Sitemap: https://businessideasdb.com/sitemap.xml # LLM-readable site index and full content (llmstxt.org convention) # LLMs: https://businessideasdb.com/llms.txt # LLMs-Full: https://businessideasdb.com/llms-full.txt