User-agent: Amazonbot Crawl-delay: 30 User-agent: MJ12bot Crawl-delay: 30 User-agent: GPTBot Crawl-delay: 30 User-agent: bingbot Crawl-delay: 30 User-agent: PetalBot Crawl-delay: 30 User-agent: SemrushBot Crawl-delay: 30 User-agent: ClaudeBot Crawl-delay: 30 User-agent: AhrefsBot Crawl-delay: 30