User-agent: Amazonbot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Bingbot Crawl-delay: 10 # Block Meta AI Training Crawlers User-agent: meta-externalagent Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: FacebookBot Disallow: / User-agent: Meta-ExternalFetcher Disallow: / # Allow link preview crawler (optional - comment out to block everything) User-agent: facebookexternalhit Allow: /