User-agent: * Disallow: /*blackhole Disallow: /?blackhole User-agent: SemrushBot Disallow: / User-agent: dotbot Disallow: /admin/ Disallow: /scripts/ Disallow: /images/ User-agent: dotbot Disallow: / User-agent: dotbot Crawl-delay: 10 User-agent: SiteAuditBot Disallow: / User-agent: SemrushBot-BA Disallow: / User-agent: SemrushBot-SI Disallow: / User-agent: SemrushBot-SWA Disallow: / User-agent: SemrushBot-CT Disallow: / User-agent: SplitSignalBot Disallow: / User-agent: SemrushBot-COUB Disallow: / #WP Import Export Rule User-agent: * Disallow: /wp-content/uploads/wp-import-export-lite/