# Sitemap Sitemap: https://trycolors.com/sitemap.xml # Default rule: disallow some directories for all bots User-agent: * Disallow: /user Disallow: /signin Disallow: /*? Disallow: /api Disallow: /colors Disallow: /palette # Allow Googlebot to crawl /colors and /palette User-agent: Googlebot Allow: /colors Allow: /palette # Explicitly disallow some bots from accessing /colors and /palette (even though the default rule already blocks them, it's clearer to state it) User-agent: dotbot Disallow: /colors Disallow: /palette User-agent: PetalBot Disallow: /colors Disallow: /palette User-agent: MJ12bot Disallow: /colors Disallow: /palette User-agent: AhrefsBot Disallow: /colors Disallow: /palette User-agent: Amazonbot Disallow: /colors Disallow: /palette User-agent: bingbot Disallow: /colors Disallow: /palette User-agent: Bytespider Disallow: /colors Disallow: /palette User-Agent: ImagesiftBot Disallow: /colors Disallow: /palette