0
Kayıt Ol

Google İndex Durması

72

●

4.978

  • 06-06-2008, 17:55:37
    #19
    dersimvatan
    dersimvatan
    Bilmiyorum ama ben çözüm üretmeye doğru gidiyorum Robotx.txt Bu şekilde yaptım sonuçları bekliyorum
    User-agent: *
    Disallow: /*ref=*
    User-agent: Mediapartners-Google*
    Disallow:
    User-agent: *
    Disallow: /wp-admin/
    User-agent: Black Hole
    Disallow: /
    User-agent: Titan
    Disallow: /
    User-agent: WebStripper
    Disallow: /
    User-agent: NetMechanic
    Disallow: /
    User-agent: CherryPicker
    Disallow: /
    User-agent: EmailCollector
    Disallow: /
    User-agent: EmailSiphon
    Disallow: /
    User-agent: WebBandit
    Disallow: /
    User-agent: EmailWolf
    Disallow: /
    User-agent: ExtractorPro
    Disallow: /
    User-agent: CopyRightCheck
    Disallow: /
    User-agent: Crescent
    Disallow: /
    User-agent: NICErsPRO
    Disallow: /
    User-agent: Wget
    Disallow: /
    User-agent: SiteSnagger
    Disallow: /
    User-agent: ProWebWalker
    Disallow: /
    User-agent: CheeseBot
    Disallow: /
    User-agent: mozilla/4
    Disallow: /
    User-agent: mozilla/5
    Disallow: /
    User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows NT)
    Disallow: /
    User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 95)
    Disallow: /
    User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 9
    Disallow: /
    User-agent: ia_archiver
    Disallow: /
    User-agent: ia_archiver/1.6
    Disallow: /
    User-agent: Alexibot
    Disallow: /
    User-agent: Teleport
    Disallow: /
    User-agent: TeleportPro
    Disallow: /
    User-agent: Wget
    Disallow: /
    User-agent: MIIxpc
    Disallow: /
    User-agent: Telesoft
    Disallow: /
    User-agent: Website Quester
    Disallow: /
    User-agent: WebZip
    Disallow: /
    User-agent: moget/2.1
    Disallow: /
    User-agent: WebZip/4.0
    Disallow: /
    User-agent: WebStripper
    Disallow: /
    User-agent: WebSauger
    Disallow: /
    User-agent: WebCopier
    Disallow: /
    User-agent: NetAnts
    Disallow: /
    User-agent: Mister PiX
    Disallow: /
    User-agent: WebAuto
    Disallow: /
    User-agent: TheNomad
    Disallow: /
    User-agent: WWW-Collector-E
    Disallow: /
    User-agent: RMA
    Disallow: /
    User-agent: libWeb/clsHTTPDisallow: /
    User-agent: asterias
    Disallow: /
    User-agent: turingos
    Disallow: /
    User-agent: spanner
    Disallow: /
    User-agent: InfoNaviRobot
    Disallow: /
    User-agent: Harvest/1.5
    Disallow: /
    User-agent: ExtractorPro
    Disallow: /
    User-agent: Bullseye/1.0
    Disallow: /
    User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95)
    Disallow: /
    User-agent: Crescent Internet ToolPak HTTPOLE Control v.1.0
    Disallow: /
    User-agent: CherryPickerSE/1.0
    Disallow: /
    User-agent: CherryPickerElite/1.0
    Disallow: /
    User-agent: WebBandit/3.50
    Disallow: /
    User-agent: NICErsPRO
    Disallow: /
    User-agent: Microsoft URL Control - 5.01.4511
    Disallow: /
    User-agent: DittoSpyder
    Disallow: /
    User-agent: Foobot
    Disallow: /
    User-agent: WebmasterWorldForumBot
    Disallow: /
    User-agent: SpankBot
    Disallow: /
    User-agent: BotALot
    Disallow: /
    User-agent: lwp-trivial/1.34
    Disallow: /
    User-agent: lwp-trivial
    Disallow: /
    User-agent: BunnySlippers
    Disallow: /
    User-agent: Microsoft URL Control - 6.00.8169
    Disallow: /
    User-agent: URLy Warning
    Disallow: /
    User-agent: Wget
    Disallow: /
    User-agent: Wget/1.5.3
    Disallow: /
    User-agent: LinkWalker
    Disallow: /
    User-agent: cosmos
    Disallow: /
    User-agent: moget
    Disallow: /
    User-agent: hloader
    Disallow: /
    User-agent: humanlinks
    Disallow: /
    User-agent: LinkextractorPro
    Disallow: /
    User-agent: Offline Explorer
    Disallow: /
    User-agent: Mata Hari
    Disallow: /
    User-agent: LexiBot
    Disallow: /
    User-agent: Offline Explorer
    Disallow: /
    User-agent: Web Image Collector
    Disallow: /
    User-agent: The Intraformant
    Disallow: /
    User-agent: True_Robot/1.0
    Disallow: /
    User-agent: True_Robot
    Disallow: /
    User-agent: BlowFish/1.0
    Disallow: /
    User-agent: JennyBot
    Disallow: /
    User-agent: MIIxpc/4.2
    Disallow: /
    User-agent: BuiltBotTough
    Disallow: /
    User-agent: ProPowerBot/2.14
    Disallow: /
    User-agent: BackDoorBot/1.0
    Disallow: /
    User-agent: toCrawl/UrlDispatcher
    Disallow: /
    User-agent: WebEnhancer
    Disallow: /
    User-agent: TightTwatBot
    Disallow: /
    User-agent: suzuran
    Disallow: /
    User-agent: VCI WebViewer VCI WebViewer Win32
    Disallow: /
    User-agent: VCI
    Disallow: /
    User-agent: Szukacz/1.4
    Disallow: /
    User-agent: QueryN Metasearch
    Disallow: /
    User-agent: Openfind data gathere
    Disallow: /
    User-agent: Openfind
    Disallow: /
    User-agent: Xenu's Link Sleuth 1.1c
    Disallow: /
    User-agent: Xenu's
    Disallow: /
    User-agent: Zeus
    Disallow: /
    User-agent: RepoMonkey Bait & Tackle/v1.01
    Disallow: /
    User-agent: RepoMonkey
    Disallow: /
    User-agent: Zeus 32297 Webster Pro V2.9 Win32
    Disallow: /
    User-agent: Webster Pro
    Disallow: /
    User-agent: EroCrawler
    Disallow: /
    User-agent: LinkScan/8.1a Unix Disallow: /
    User-agent: Kenjin Spider
    Disallow: /
    User-agent: Keyword Density/0.9
    Disallow: /
    User-agent: Kenjin Spider
    Disallow: /
    User-agent: Cegbfeieh
    Disallow: /
    Different:
    User-agent: larbin
    Disallow: /
    User-agent: b2w/0.1
    Disallow: /
    User-agent: Copernic
    Disallow: /
    User-agent: psbot
    Disallow: /
    User-agent: Python-urllib
    Disallow: /


    User-agent: NetMechanic
    Disallow: /
    User-agent: URL_Spider_Pro
    Disallow: /
    User-agent: CherryPicker
    Disallow: /
    User-agent: EmailCollector
    Disallow: /
    User-agent: EmailSiphon
    Disallow: /
    User-agent: WebBandit
    Disallow: /
    User-agent: EmailWolf
    Disallow: /
    User-agent: ExtractorPro
    Disallow: /
    User-agent: CopyRightCheck
    Disallow: /
    User-agent: Crescent
    Disallow: /
    User-agent: SiteSnagger
    Disallow: /
    User-agent: ProWebWalker
    Disallow: /
    User-agent: CheeseBot
    Disallow: /
    User-agent: LNSpiderguy
    Disallow: /
    User-agent: Mozilla
    Disallow: /
    User-agent: mozilla
    Disallow: /
    User-agent: mozilla/3
    Disallow: /
    User-agent: mozilla/4
    Disallow: /
    User-agent: mozilla/5
    Disallow: /
    User-agent: WebAuto
    Disallow: /
    User-agent: TheNomad
    Disallow: /
    User-agent: WWW-Collector-E
    Disallow: /
    User-agent: RMA
    Disallow: /
    User-agent: libWeb/clsHTTP
    Disallow: /
    User-agent: httplib
    Disallow: /
    User-agent: turingos
    Disallow: /
    User-agent: InfoNaviRobot
    Disallow: /
    User-agent: Harvest/1.5
    Disallow: /
    User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
    Disallow: /
    User-agent: CherryPickerSE/1.0
    Disallow: /
    User-agent: CherryPickerElite/1.0
    Disallow: /
    User-agent: WebBandit/3.50
    Disallow: /
    User-agent: NICErsPRO
    Disallow: /
    User-agent: DittoSpyder
    Disallow: /
    User-agent: Foobot
    Disallow: /
    User-agent: BotALot
    Disallow: /
    User-agent: lwp-trivial/1.34
    Disallow: /
    User-agent: lwp-trivial
    Disallow: /
    User-agent: URLy Warning
    Disallow: /
    User-agent: hloader
    Disallow: /
    User-agent: humanlinks
    Disallow: /
    User-agent: LinkextractorPro
    Disallow: /
    User-agent: Offline Explorer
    Disallow: /
    User-agent: Mata Hari
    Disallow: /
    User-agent: LexiBot
    Disallow: /
    User-agent: Web Image Collector
    Disallow: /
    User-agent: The Intraformant
    Disallow: /
    User-agent: True_Robot/1.0
    Disallow: /
    User-agent: True_Robot
    Disallow: /
    User-agent: BlowFish/1.0
    Disallow: /
    User-agent: JennyBot
    Disallow: /
    User-agent: MIIxpc/4.2
    Disallow: /
    User-agent: BuiltBotTough
    Disallow: /
    User-agent: ProPowerBot/2.14
    Disallow: /
    User-agent: BackDoorBot/1.0
    Disallow: /
    User-agent: toCrawl/UrlDispatcher
    Disallow: /
    User-agent: WebEnhancer
    Disallow: /
    User-agent: suzuran
    Disallow: /
    User-agent: VCI WebViewer VCI WebViewer Win32
    Disallow: /
    User-agent: VCI
    Disallow: /
    User-agent: Szukacz/1.4
    Disallow: /
    User-agent: QueryN Metasearch
    Disallow: /
    User-agent: Openfind data gathere
    Disallow: /
    User-agent: Openfind
    Disallow: /
    User-agent: Xenu's Link Sleuth 1.1c
    Disallow: /
    User-agent: Xenu's
    Disallow: /
    User-agent: Zeus
    Disallow: /
    User-agent: RepoMonkey Bait & Tackle/v1.01
    Disallow: /
    User-agent: RepoMonkey
    Disallow: /
    User-agent: Openbot
    Disallow: /
    User-agent: URL Control
    Disallow: /
    User-agent: Zeus Link Scout
    Disallow: /
    User-agent: Zeus 32297 Webster Pro V2.9 Win32
    Disallow: /
    User-agent: EroCrawler
    Disallow: /
    User-agent: LinkScan/8.1a Unix
    Disallow: /
    User-agent: Keyword Density/0.9
    Disallow: /
    User-agent: Kenjin Spider
    Disallow: /
    User-agent: Iron33/1.0.2
    Disallow: /
    User-agent: Bookmark search tool
    Disallow: /
    User-agent: GetRight/4.2
    Disallow: /
    User-agent: FairAd Client
    Disallow: /
    User-agent: Gaisbot
    Disallow: /
    User-agent: Aqua_Products
    Disallow: /
    User-agent: Radiation Retriever 1.1
    Disallow: /
    User-agent: WebmasterWorld Extractor
    Disallow: /
    User-agent: Flaming AttackBot
    Disallow: /
    User-agent: Oracle Ultra Search
    Disallow: /
    User-agent: MSIECrawler
    Disallow: /
    User-agent: PerMan
    Disallow: /
    User-agent: searchpreview
    Disallow: /
    User-agent: naver
    Disallow: /
    User-agent: dumbot
    Disallow: /
    User-agent: Hatena Antenna
    Disallow: /
    User-agent: grub-client
    Disallow: /
    User-agent: grub
    Disallow: /
    User-agent: larbin
    Disallow: /
    User-agent: b2w/0.1
    Disallow: /
    User-agent: Copernic
    Disallow: /
    User-agent: psbot
    Disallow: /
    User-agent: Python-urllib
    Disallow: /
    User-agent: EmailWolf
    Disallow: /
    User-agent: ExtractorPro
    Disallow: /
    User-agent: CopyRightCheck
    Disallow: /
    User-agent: Crescent
    Disallow: /
    User-agent: SiteSnagger
    Disallow: /
    User-agent: ProWebWalker
    Disallow: /
    User-agent: CheeseBot
    Disallow: /
    User-agent: LNSpiderguy
    Disallow: /
    User-agent: Mister PiX
    Disallow: /
    User-agent: WebAuto
    Disallow: /
    User-agent: TheNomad
    Disallow: /
    User-agent: WWW-Collector-E
    Disallow: /
    User-agent: RMA
    Disallow: /
    User-agent: httplib
    Disallow: /
    User-agent: turingos
    Disallow: /
    User-agent: InfoNaviRobot
    Disallow: /
    User-agent: Harvest/1.5
    Disallow: /
    User-agent: Bullseye/1.0
    Disallow: /
    User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95)
    Disallow: /
    User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
    Disallow: /
    User-agent: CherryPickerSE/1.0
    Disallow: /
    User-agent: CherryPickerElite/1.0
    Disallow: /
    User-agent: NICErsPRO
    Disallow: /
    User-agent: URLy Warning
    Disallow: /
    User-agent: humanlinks
    Disallow: /
    User-agent: Web Image Collector
    Disallow: /
    User-agent: The Intraformant
    Disallow: /
    User-agent: True_Robot/1.0
    Disallow: /
    User-agent: True_Robot
    Disallow: /
    User-agent: BlowFish/1.0
    Disallow: /
    User-agent: JennyBot
    Disallow: /
    User-agent: MIIxpc/4.2
    Disallow: /
    User-agent: BuiltBotTough
    Disallow: /
    User-agent: ProPowerBot/2.14
    Disallow: /
    User-agent: BackDoorBot/1.0
    Disallow: /
    User-agent: toCrawl/UrlDispatcher
    Disallow: /
    User-agent: WebEnhancer
    Disallow: /
    User-agent: suzuran
    Disallow: /
    User-agent: VCI WebViewer VCI WebViewer Win32
    Disallow: /
    User-agent: VCI
    Disallow: /
    User-agent: Szukacz/1.4
    Disallow: /
    User-agent: QueryN Metasearch
    Disallow: /
    User-agent: Openfind data gathere
    Disallow: /
    User-agent: Openfind
    Disallow: /
    User-agent: Xenu's Link Sleuth 1.1c
    Disallow: /
    User-agent: Xenu's
    Disallow: /
    User-agent: Zeus
    Disallow: /
    User-agent: RepoMonkey Bait & Tackle/v1.01
    Disallow: /
    User-agent: RepoMonkey
    Disallow: /
    User-agent: Microsoft URL Control
    Disallow: /
    User-agent: Openbot
    Disallow: /
    User-agent: URL Control
    Disallow: /
    User-agent: Zeus Link Scout
    Disallow: /
    User-agent: Zeus 32297 Webster Pro V2.9 Win32
    Disallow: /
    User-agent: Webster Pro
    Disallow: /
    User-agent: EroCrawler
    Disallow: /
    User-agent: LinkScan/8.1a Unix
    Disallow: /
    User-agent: Keyword Density/0.9
    Disallow: /
    User-agent: Kenjin Spider
    Disallow: /
    User-agent: Iron33/1.0.2
    Disallow: /
    User-agent: Bookmark search tool
    Disallow: /
    User-agent: GetRight/4.2
    Disallow: /
    User-agent: FairAd Client
    Disallow: /
    User-agent: Gaisbot
    Disallow: /
    User-agent: Aqua_Products
    Disallow: /
    User-agent: Radiation Retriever 1.1
    Disallow: /
    User-agent: WebmasterWorld Extractor
    Disallow: /
    User-agent: Flaming AttackBot
    Disallow: /
    User-agent: Oracle Ultra Search
    Disallow: /
    User-agent: MSIECrawler
    Disallow: /
    User-agent: PerMan
    Disallow: /
    User-agent: searchpreview
    Disallow: /
    User-agent: sootle
    Disallow: /
    User-agent: es
    Disallow: /
    User-agent: Enterprise_Search/1.0
    Disallow: /
    User-agent: Enterprise_Search
    Disallow: /
    [/QUOTE]


    Belki İşinize Yarar
  • 06-06-2008, 18:03:11
    #20
    Seza
    Seza
    Bendede İndexlenmiyor,Sanırım Örümceklerin Maması Bitmiş.
  • 06-06-2008, 19:00:51
    #21
    SNaRe
    SNaRe
    Üyeliği durduruldu
    Kendini biraz fazla kasmışsın bu kadar şey yerine
    User-Agent: *
Disallow: /wp-content/
Sitemap: http://www.xxxx.com/sitemap.xml
    Bunu yaaprsan zaten otomatik olarak bütün botlara izin verir

    DersiMVataN adlı üyeden alıntı: mesajı görüntüle
    Bilmiyorum ama ben çözüm üretmeye doğru gidiyorum Robotx.txt Bu şekilde yaptım sonuçları bekliyorum
    User-agent: *
    Disallow: /*ref=*
    User-agent: Mediapartners-Google*
    Disallow:
    User-agent: *
    Disallow: /wp-admin/
    User-agent: Black Hole
    Disallow: /
    User-agent: Titan
    Disallow: /
    User-agent: WebStripper
    Disallow: /
    User-agent: NetMechanic
    Disallow: /
    User-agent: CherryPicker
    Disallow: /
    User-agent: EmailCollector
    Disallow: /
    User-agent: EmailSiphon
    Disallow: /
    User-agent: WebBandit
    Disallow: /
    User-agent: EmailWolf
    Disallow: /
    User-agent: ExtractorPro
    Disallow: /
    User-agent: CopyRightCheck
    Disallow: /
    User-agent: Crescent
    Disallow: /
    User-agent: NICErsPRO
    Disallow: /
    User-agent: Wget
    Disallow: /
    User-agent: SiteSnagger
    Disallow: /
    User-agent: ProWebWalker
    Disallow: /
    User-agent: CheeseBot
    Disallow: /
    User-agent: mozilla/4
    Disallow: /
    User-agent: mozilla/5
    Disallow: /
    User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows NT)
    Disallow: /
    User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 95)
    Disallow: /
    User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 9
    Disallow: /
    User-agent: ia_archiver
    Disallow: /
    User-agent: ia_archiver/1.6
    Disallow: /
    User-agent: Alexibot
    Disallow: /
    User-agent: Teleport
    Disallow: /
    User-agent: TeleportPro
    Disallow: /
    User-agent: Wget
    Disallow: /
    User-agent: MIIxpc
    Disallow: /
    User-agent: Telesoft
    Disallow: /
    User-agent: Website Quester
    Disallow: /
    User-agent: WebZip
    Disallow: /
    User-agent: moget/2.1
    Disallow: /
    User-agent: WebZip/4.0
    Disallow: /
    User-agent: WebStripper
    Disallow: /
    User-agent: WebSauger
    Disallow: /
    User-agent: WebCopier
    Disallow: /
    User-agent: NetAnts
    Disallow: /
    User-agent: Mister PiX
    Disallow: /
    User-agent: WebAuto
    Disallow: /
    User-agent: TheNomad
    Disallow: /
    User-agent: WWW-Collector-E
    Disallow: /
    User-agent: RMA
    Disallow: /
    User-agent: libWeb/clsHTTPDisallow: /
    User-agent: asterias
    Disallow: /
    User-agent: turingos
    Disallow: /
    User-agent: spanner
    Disallow: /
    User-agent: InfoNaviRobot
    Disallow: /
    User-agent: Harvest/1.5
    Disallow: /
    User-agent: ExtractorPro
    Disallow: /
    User-agent: Bullseye/1.0
    Disallow: /
    User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95)
    Disallow: /
    User-agent: Crescent Internet ToolPak HTTPOLE Control v.1.0
    Disallow: /
    User-agent: CherryPickerSE/1.0
    Disallow: /
    User-agent: CherryPickerElite/1.0
    Disallow: /
    User-agent: WebBandit/3.50
    Disallow: /
    User-agent: NICErsPRO
    Disallow: /
    User-agent: Microsoft URL Control - 5.01.4511
    Disallow: /
    User-agent: DittoSpyder
    Disallow: /
    User-agent: Foobot
    Disallow: /
    User-agent: WebmasterWorldForumBot
    Disallow: /
    User-agent: SpankBot
    Disallow: /
    User-agent: BotALot
    Disallow: /
    User-agent: lwp-trivial/1.34
    Disallow: /
    User-agent: lwp-trivial
    Disallow: /
    User-agent: BunnySlippers
    Disallow: /
    User-agent: Microsoft URL Control - 6.00.8169
    Disallow: /
    User-agent: URLy Warning
    Disallow: /
    User-agent: Wget
    Disallow: /
    User-agent: Wget/1.5.3
    Disallow: /
    User-agent: LinkWalker
    Disallow: /
    User-agent: cosmos
    Disallow: /
    User-agent: moget
    Disallow: /
    User-agent: hloader
    Disallow: /
    User-agent: humanlinks
    Disallow: /
    User-agent: LinkextractorPro
    Disallow: /
    User-agent: Offline Explorer
    Disallow: /
    User-agent: Mata Hari
    Disallow: /
    User-agent: LexiBot
    Disallow: /
    User-agent: Offline Explorer
    Disallow: /
    User-agent: Web Image Collector
    Disallow: /
    User-agent: The Intraformant
    Disallow: /
    User-agent: True_Robot/1.0
    Disallow: /
    User-agent: True_Robot
    Disallow: /
    User-agent: BlowFish/1.0
    Disallow: /
    User-agent: JennyBot
    Disallow: /
    User-agent: MIIxpc/4.2
    Disallow: /
    User-agent: BuiltBotTough
    Disallow: /
    User-agent: ProPowerBot/2.14
    Disallow: /
    User-agent: BackDoorBot/1.0
    Disallow: /
    User-agent: toCrawl/UrlDispatcher
    Disallow: /
    User-agent: WebEnhancer
    Disallow: /
    User-agent: TightTwatBot
    Disallow: /
    User-agent: suzuran
    Disallow: /
    User-agent: VCI WebViewer VCI WebViewer Win32
    Disallow: /
    User-agent: VCI
    Disallow: /
    User-agent: Szukacz/1.4
    Disallow: /
    User-agent: QueryN Metasearch
    Disallow: /
    User-agent: Openfind data gathere
    Disallow: /
    User-agent: Openfind
    Disallow: /
    User-agent: Xenu's Link Sleuth 1.1c
    Disallow: /
    User-agent: Xenu's
    Disallow: /
    User-agent: Zeus
    Disallow: /
    User-agent: RepoMonkey Bait & Tackle/v1.01
    Disallow: /
    User-agent: RepoMonkey
    Disallow: /
    User-agent: Zeus 32297 Webster Pro V2.9 Win32
    Disallow: /
    User-agent: Webster Pro
    Disallow: /
    User-agent: EroCrawler
    Disallow: /
    User-agent: LinkScan/8.1a Unix Disallow: /
    User-agent: Kenjin Spider
    Disallow: /
    User-agent: Keyword Density/0.9
    Disallow: /
    User-agent: Kenjin Spider
    Disallow: /
    User-agent: Cegbfeieh
    Disallow: /
    Different:
    User-agent: larbin
    Disallow: /
    User-agent: b2w/0.1
    Disallow: /
    User-agent: Copernic
    Disallow: /
    User-agent: psbot
    Disallow: /
    User-agent: Python-urllib
    Disallow: /
    User-agent: NetMechanic
    Disallow: /
    User-agent: URL_Spider_Pro
    Disallow: /
    User-agent: CherryPicker
    Disallow: /
    User-agent: EmailCollector
    Disallow: /
    User-agent: EmailSiphon
    Disallow: /
    User-agent: WebBandit
    Disallow: /
    User-agent: EmailWolf
    Disallow: /
    User-agent: ExtractorPro
    Disallow: /
    User-agent: CopyRightCheck
    Disallow: /
    User-agent: Crescent
    Disallow: /
    User-agent: SiteSnagger
    Disallow: /
    User-agent: ProWebWalker
    Disallow: /
    User-agent: CheeseBot
    Disallow: /
    User-agent: LNSpiderguy
    Disallow: /
    User-agent: Mozilla
    Disallow: /
    User-agent: mozilla
    Disallow: /
    User-agent: mozilla/3
    Disallow: /
    User-agent: mozilla/4
    Disallow: /
    User-agent: mozilla/5
    Disallow: /
    User-agent: WebAuto
    Disallow: /
    User-agent: TheNomad
    Disallow: /
    User-agent: WWW-Collector-E
    Disallow: /
    User-agent: RMA
    Disallow: /
    User-agent: libWeb/clsHTTP
    Disallow: /
    User-agent: httplib
    Disallow: /
    User-agent: turingos
    Disallow: /
    User-agent: InfoNaviRobot
    Disallow: /
    User-agent: Harvest/1.5
    Disallow: /
    User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
    Disallow: /
    User-agent: CherryPickerSE/1.0
    Disallow: /
    User-agent: CherryPickerElite/1.0
    Disallow: /
    User-agent: WebBandit/3.50
    Disallow: /
    User-agent: NICErsPRO
    Disallow: /
    User-agent: DittoSpyder
    Disallow: /
    User-agent: Foobot
    Disallow: /
    User-agent: BotALot
    Disallow: /
    User-agent: lwp-trivial/1.34
    Disallow: /
    User-agent: lwp-trivial
    Disallow: /
    User-agent: URLy Warning
    Disallow: /
    User-agent: hloader
    Disallow: /
    User-agent: humanlinks
    Disallow: /
    User-agent: LinkextractorPro
    Disallow: /
    User-agent: Offline Explorer
    Disallow: /
    User-agent: Mata Hari
    Disallow: /
    User-agent: LexiBot
    Disallow: /
    User-agent: Web Image Collector
    Disallow: /
    User-agent: The Intraformant
    Disallow: /
    User-agent: True_Robot/1.0
    Disallow: /
    User-agent: True_Robot
    Disallow: /
    User-agent: BlowFish/1.0
    Disallow: /
    User-agent: JennyBot
    Disallow: /
    User-agent: MIIxpc/4.2
    Disallow: /
    User-agent: BuiltBotTough
    Disallow: /
    User-agent: ProPowerBot/2.14
    Disallow: /
    User-agent: BackDoorBot/1.0
    Disallow: /
    User-agent: toCrawl/UrlDispatcher
    Disallow: /
    User-agent: WebEnhancer
    Disallow: /
    User-agent: suzuran
    Disallow: /
    User-agent: VCI WebViewer VCI WebViewer Win32
    Disallow: /
    User-agent: VCI
    Disallow: /
    User-agent: Szukacz/1.4
    Disallow: /
    User-agent: QueryN Metasearch
    Disallow: /
    User-agent: Openfind data gathere
    Disallow: /
    User-agent: Openfind
    Disallow: /
    User-agent: Xenu's Link Sleuth 1.1c
    Disallow: /
    User-agent: Xenu's
    Disallow: /
    User-agent: Zeus
    Disallow: /
    User-agent: RepoMonkey Bait & Tackle/v1.01
    Disallow: /
    User-agent: RepoMonkey
    Disallow: /
    User-agent: Openbot
    Disallow: /
    User-agent: URL Control
    Disallow: /
    User-agent: Zeus Link Scout
    Disallow: /
    User-agent: Zeus 32297 Webster Pro V2.9 Win32
    Disallow: /
    User-agent: EroCrawler
    Disallow: /
    User-agent: LinkScan/8.1a Unix
    Disallow: /
    User-agent: Keyword Density/0.9
    Disallow: /
    User-agent: Kenjin Spider
    Disallow: /
    User-agent: Iron33/1.0.2
    Disallow: /
    User-agent: Bookmark search tool
    Disallow: /
    User-agent: GetRight/4.2
    Disallow: /
    User-agent: FairAd Client
    Disallow: /
    User-agent: Gaisbot
    Disallow: /
    User-agent: Aqua_Products
    Disallow: /
    User-agent: Radiation Retriever 1.1
    Disallow: /
    User-agent: WebmasterWorld Extractor
    Disallow: /
    User-agent: Flaming AttackBot
    Disallow: /
    User-agent: Oracle Ultra Search
    Disallow: /
    User-agent: MSIECrawler
    Disallow: /
    User-agent: PerMan
    Disallow: /
    User-agent: searchpreview
    Disallow: /
    User-agent: naver
    Disallow: /
    User-agent: dumbot
    Disallow: /
    User-agent: Hatena Antenna
    Disallow: /
    User-agent: grub-client
    Disallow: /
    User-agent: grub
    Disallow: /
    User-agent: larbin
    Disallow: /
    User-agent: b2w/0.1
    Disallow: /
    User-agent: Copernic
    Disallow: /
    User-agent: psbot
    Disallow: /
    User-agent: Python-urllib
    Disallow: /
    User-agent: EmailWolf
    Disallow: /
    User-agent: ExtractorPro
    Disallow: /
    User-agent: CopyRightCheck
    Disallow: /
    User-agent: Crescent
    Disallow: /
    User-agent: SiteSnagger
    Disallow: /
    User-agent: ProWebWalker
    Disallow: /
    User-agent: CheeseBot
    Disallow: /
    User-agent: LNSpiderguy
    Disallow: /
    User-agent: Mister PiX
    Disallow: /
    User-agent: WebAuto
    Disallow: /
    User-agent: TheNomad
    Disallow: /
    User-agent: WWW-Collector-E
    Disallow: /
    User-agent: RMA
    Disallow: /
    User-agent: httplib
    Disallow: /
    User-agent: turingos
    Disallow: /
    User-agent: InfoNaviRobot
    Disallow: /
    User-agent: Harvest/1.5
    Disallow: /
    User-agent: Bullseye/1.0
    Disallow: /
    User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95)
    Disallow: /
    User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
    Disallow: /
    User-agent: CherryPickerSE/1.0
    Disallow: /
    User-agent: CherryPickerElite/1.0
    Disallow: /
    User-agent: NICErsPRO
    Disallow: /
    User-agent: URLy Warning
    Disallow: /
    User-agent: humanlinks
    Disallow: /
    User-agent: Web Image Collector
    Disallow: /
    User-agent: The Intraformant
    Disallow: /
    User-agent: True_Robot/1.0
    Disallow: /
    User-agent: True_Robot
    Disallow: /
    User-agent: BlowFish/1.0
    Disallow: /
    User-agent: JennyBot
    Disallow: /
    User-agent: MIIxpc/4.2
    Disallow: /
    User-agent: BuiltBotTough
    Disallow: /
    User-agent: ProPowerBot/2.14
    Disallow: /
    User-agent: BackDoorBot/1.0
    Disallow: /
    User-agent: toCrawl/UrlDispatcher
    Disallow: /
    User-agent: WebEnhancer
    Disallow: /
    User-agent: suzuran
    Disallow: /
    User-agent: VCI WebViewer VCI WebViewer Win32
    Disallow: /
    User-agent: VCI
    Disallow: /
    User-agent: Szukacz/1.4
    Disallow: /
    User-agent: QueryN Metasearch
    Disallow: /
    User-agent: Openfind data gathere
    Disallow: /
    User-agent: Openfind
    Disallow: /
    User-agent: Xenu's Link Sleuth 1.1c
    Disallow: /
    User-agent: Xenu's
    Disallow: /
    User-agent: Zeus
    Disallow: /
    User-agent: RepoMonkey Bait & Tackle/v1.01
    Disallow: /
    User-agent: RepoMonkey
    Disallow: /
    User-agent: Microsoft URL Control
    Disallow: /
    User-agent: Openbot
    Disallow: /
    User-agent: URL Control
    Disallow: /
    User-agent: Zeus Link Scout
    Disallow: /
    User-agent: Zeus 32297 Webster Pro V2.9 Win32
    Disallow: /
    User-agent: Webster Pro
    Disallow: /
    User-agent: EroCrawler
    Disallow: /
    User-agent: LinkScan/8.1a Unix
    Disallow: /
    User-agent: Keyword Density/0.9
    Disallow: /
    User-agent: Kenjin Spider
    Disallow: /
    User-agent: Iron33/1.0.2
    Disallow: /
    User-agent: Bookmark search tool
    Disallow: /
    User-agent: GetRight/4.2
    Disallow: /
    User-agent: FairAd Client
    Disallow: /
    User-agent: Gaisbot
    Disallow: /
    User-agent: Aqua_Products
    Disallow: /
    User-agent: Radiation Retriever 1.1
    Disallow: /
    User-agent: WebmasterWorld Extractor
    Disallow: /
    User-agent: Flaming AttackBot
    Disallow: /
    User-agent: Oracle Ultra Search
    Disallow: /
    User-agent: MSIECrawler
    Disallow: /
    User-agent: PerMan
    Disallow: /
    User-agent: searchpreview
    Disallow: /
    User-agent: sootle
    Disallow: /
    User-agent: es
    Disallow: /
    User-agent: Enterprise_Search/1.0
    Disallow: /
    User-agent: Enterprise_Search
    Disallow: /
    Belki İşinize Yarar [/QUOTE]
  • 06-06-2008, 19:01:23
    #22
    SNaRe
    SNaRe
    Üyeliği durduruldu
    Kendini biraz fazla kasmışsın bu kadar şey yerine
    User-Agent: *
Disallow: /wp-content/
Sitemap: http://www.xxxx.com/sitemap.xml
    Bunu yaaprsan zaten otomatik olarak bütün botlara izin verir

    DersiMVataN adlı üyeden alıntı: mesajı görüntüle
    Bilmiyorum ama ben çözüm üretmeye doğru gidiyorum Robotx.txt Bu şekilde yaptım sonuçları bekliyorum
    User-agent: *
    Disallow: /*ref=*
    User-agent: Mediapartners-Google*
    Disallow:
    User-agent: *
    Disallow: /wp-admin/
    User-agent: Black Hole
    Disallow: /
    User-agent: Titan
    Disallow: /
    User-agent: WebStripper
    Disallow: /
    User-agent: NetMechanic
    Disallow: /
    User-agent: CherryPicker
    Disallow: /
    User-agent: EmailCollector
    Disallow: /
    User-agent: EmailSiphon
    Disallow: /
    User-agent: WebBandit
    Disallow: /
    User-agent: EmailWolf
    Disallow: /
    User-agent: ExtractorPro
    Disallow: /
    User-agent: CopyRightCheck
    Disallow: /
    ...................
    .............
    Belki İşinize Yarar
  • 06-06-2008, 19:23:39
    #23
    Masterdevil
    Masterdevil
    Üyeliği durduruldu
    valued adlı üyeden alıntı: mesajı görüntüle
    evet ya bende 1 haftadır falan duruyor aksine düşüyor ayrıca hergün içerik yüklememe rağmen durdurdum içerik yüklemeyi
    Neden durdurdun ? Sen icerikleri google icin mi yukluyorsun ?

  • 07-06-2008, 00:11:53
    #24
    dersimvatan
    dersimvatan
    SNaRe adlı üyeden alıntı: mesajı görüntüle
    Kendini biraz fazla kasmışsın bu kadar şey yerine
    User-Agent: *
Disallow: /wp-content/
Sitemap: http://www.xxxx.com/sitemap.xml
    Bunu yaaprsan zaten otomatik olarak bütün botlara izin verir
    valla çıldırmışım ondandr heralde ne yapiim gelmiyor güzelim bot bide explorerla carken sitemap'o
    XML sayfası görüntülenemiyor
    XML girişi XSL stil sayfası kullanılarak görüntülenemez. Lütfen hatayı düzeltin ve Yinele düğmesini tıklatın veya daha sonra yeniden deneyin.


    --------------------------------------------------------------------------------

    Erişim engellendi. 'http://www.site.com/wp-content/plugins/google-sitemap-generator/sitemap.xsl' kaynağı işlenirken hat...
    veriyr ancak firefoxda calısıyor bot gorurmu bunu acaba ?
  • 07-06-2008, 00:17:01
    #25
    Nettek
    Nettek
    Üyeliği durduruldu
    DersiMVataN adlı üyeden alıntı: mesajı görüntüle
    valla çıldırmışım ondandr heralde ne yapiim gelmiyor güzelim bot bide explorerla carken sitemap'o
    XML sayfası görüntülenemiyor
    XML girişi XSL stil sayfası kullanılarak görüntülenemez. Lütfen hatayı düzeltin ve Yinele düğmesini tıklatın veya daha sonra yeniden deneyin.
    --------------------------------------------------------------------------------
    Erişim engellendi. 'http://www.site.com/wp-content/plugins/google-sitemap-generator/sitemap.xsl' kaynağı işlenirken hat...
    veriyr ancak firefoxda calısıyor bot gorurmu bunu acaba ?
    görmemesinde bir engel yok gibi.
  • 07-06-2008, 02:05:24
    #26
    dersimvatan
    dersimvatan
    ben günlük posrt gene atmaya devam ediyorum işallah Gugildaki bu index durgunlgu geçiçidir
  • 07-06-2008, 02:13:52
    #27
    Lzrdnc
    Lzrdnc
    1 sitem 5 mayistan beri indexlenmiyor,,

    Bekliyoruz hala orumcek bot karafatma falan