Şu konuyu dirilteyim.
Bendede aynı sorun var robots.txt demi bir sorun var.
User-agent: Googlebot
Disallow:
User-agent: Googlebot-Image:
Disallow:
User-agent: Mediapartners-Google
Disallow:
User-agent: MSNbot
Disallow:
User-agent: Googlebot-Mobile:
Disallow:
User-agent: ia_archiver
Disallow:
User-agent: Slurp
Disallow:
User-agent: Robozilla
Disallow:
User-agent: yahoo-mmcrawler
Disallow:
User-agent: psbot
Disallow:
User-agent: yahoo-blogs/v3.9
Disallow:
Bunlar izin verdiklerim.