Merhabalar

Şimdi robots.txt baktımda aşağıdaki gibi sizce bu robots.txt dosyası doğru mu?


User-agent: *
Allow: /wp-admin/admin-ajax.php
Disallow: /forum/
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/plugins/
Disallow: /wp-content/themes/
Disallow: /trackback
Disallow: /comments
Disallow: /feed
User-agent: AhrefsSiteAudit
Allow: /

User-agent: AhrefsBot
Allow: /

User-agent: Googlebot
Disallow: /wp-includes/
Disallow: /tag/*
Disallow: /category/
Disallow: /archives/
Disallow: /comments/feed/
Disallow: /trackback/
Disallow: /index.php
Disallow: /xmlrpc.php
Disallow: *?wptheme
Disallow: ?comments=*
Disallow: /search?
Disallow: /?p=*
Disallow: /*page/*
Disallow: */trackback
Disallow: *?replytocom
Disallow: /*/feed
Disallow: /category/*/*
Disallow: /*?*
Disallow: /*?

Sitemap: https://xxxxxx.com/sitemap_index.xml