User-agent: * Allow: / # Block logo animation from being indexed as video content Disallow: /vocuno-logo-animation* # Auth-gated routes (no indexable content) # /app intentionally NOT disallowed: Googlebot must be allowed to crawl it so it can read the # runtime tag set by useNoindex() in AppPage.tsx. # A robots.txt Disallow alone cannot remove URLs that are already indexed (Google indexes them # from inbound links without crawling). Allowing crawl + serving noindex is the canonical fix. Disallow: /studio Disallow: /settings Disallow: /checkout-success Disallow: /listen/profile Disallow: /admin Disallow: /add-vocals$ Disallow: /stem-separation$ Disallow: /profile # Throttle generic crawlers. Ignored by Googlebot (use Search Console crawl-rate # settings for it) but respected by Bing, Yandex and many well-behaved bots. Crawl-delay: 10 # High-volume AI/scraper bots that crawl the full i18n sitemap repeatedly and have # driven large Firebase Hosting egress spikes. We block them outright — they bring # no search/referral traffic. Search engines above are unaffected. User-agent: GPTBot Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Claude-Web Disallow: / User-agent: anthropic-ai Disallow: / User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: meta-externalagent Disallow: / User-agent: Diffbot Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: PetalBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / Sitemap: https://vocuno.com/sitemap.xml Sitemap: https://vocuno.com/sitemap-i18n.xml Sitemap: https://vocuno.com/sitemap-marketplace.xml