Şu anda kendim de kullanıyorum. robots.txt dosyanızı açın ve verdiklerimi ekleyin. Faydasını siz görürsünüz.
Alıntı
Disallow: /wp-admin/
Disallow: /wp-content/
Disallow: /wp-includes/
Disallow: /wp-config.php
Disallow: /wp-login.php
Disallow: /wp-pass.php
Disallow: /wp-register.php
Disallow: /wp-settings.php
Disallow: /wp-includes
Disallow: /comments
Disallow: */comments
Disallow: /comment
Disallow: */comment
Disallow: /comment-page-1
Disallow: */comment-page-1
Disallow: /*?*
Disallow: /*?
Disallow: /*ref*
Disallow: /?id=
Disallow: /*pg=*
Disallow: /*pg=
Disallow: /?pg=
Disallow: ?pg=
Disallow: /?pg
Disallow: /*ref=*
Disallow: /*ref
Disallow: /?ref
Disallow: ?ref
Disallow: /?id
Disallow: /page/*ref=
Disallow: /page/?ref=
Disallow: /page/?id=
Disallow: /page/*ref=*
Disallow: /page/?id
Disallow: /page/*ref*