# robots.txt for prdt.com.sg User-agent: * Allow: / Disallow: /cgi-bin/ Disallow: /private/ Disallow: /*?utm_* # Allow social-media crawlers explicit access User-agent: facebookexternalhit Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / User-agent: WhatsApp Allow: / # Block AI training crawlers (optional — remove to allow) User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: ClaudeBot Disallow: / Sitemap: https://www.prdt.com.sg/sitemap.xml