# DataCleanist robots.txt # Update the Sitemap URL to the production domain at deploy time. User-agent: * Allow: / Disallow: /eda Disallow: /chat Disallow: /clean Disallow: /profile Disallow: /api-keys Disallow: /payment/ Sitemap: https://www.datacleanist.com/sitemap.xml