User-agent: * Crawl-delay: 2 Disallow: /admin Disallow: /account/ Disallow: /cart/ Disallow: /compare/ Disallow: /checkout/ User-agent: * Disallow: /admin/ Disallow: /checkout/ Disallow: /cart/ Disallow: /login/ Disallow: /register/ Disallow: /account/ Disallow: /search/ # Allow crawlers to access the site map Sitemap: https://www.canvasso.com/sitemap.xml # Block specific bots if necessary (example below) User-agent: BadBot Disallow: / # Allow certain crawlers to specific folders (optional) User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / # Block specific file types User-agent: * Disallow: /*.pdf$ Disallow: /*.doc$ Disallow: /*.zip$ Sitemap: https://canvasso-348812.webshopapp.com/sitemap.xml