User-agent: *
Disallow: /xxx

bunu robots.txt olarak kaydet at anadizine