Kendi kullandıgım robots.txt

User-agent: *
allow:
User-Agent: Adsbot-Google
Allow: /
User-Agent: Googlebot-Image
Allow: /
User-Agent: Googlebot-Mobile
Allow: /
User-agent: Mediapartners-Google*
User-agent: Googlebot
User-agent: *
Disallow: /?ref=

Sitemap: http://www.siteadi.net/sitemap.xml.gz