User-agent: * Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /category/* Disallow: /trackback Disallow: */trackback Disallow: /comments Disallow: */comments Disallow: /feed Disallow: */feed Disallow: /comments/feed Disallow: */comments/feed User-agent: SEMrushBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: Mediatoolkitbot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: SEOkicks Disallow: / User-agent: YandexBot Disallow: / User-agent: Baiduspider Disallow: /