#User-agent: * Disallow: /cache/ # Example 1: Block a specific malicious bot User-agent: BadBotName Disallow: / # Example 2: Block popular AI/Scraping bots User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / # Example 3: Block the generic Mozilla/5.0 agent from your last log # WARNING: This might block legitimate old browsers, use with caution! User-agent: Mozilla/5.0 Disallow: /