Irobhoti.txt faira yakachengetwa mumudzi we webhusaiti yako inotaurira robots webhusaiti sekutsvaga injini spiders zvinyorwa uye mafaira vanobvumirwa kukwira. Zviri nyore kushandisa robots.txt faira, asi pane zvimwe zvaunofanira kuyeuka:
- Dhiyabhorosi dzebhubhu dzvuku dzingashaya ma robots.txt faira yako. Mhando dzakawanda ndeye botsware nemabhobhoti vachitsvaga kero dze email kuti vagokohwa.
- Vamwe vatsva vepurogiramu vachanyora mabhobhoti asina hanya ne robots.txt faira. Izvi zvinowanzoitwa nekukanganisa.
- Munhu wose anogona kuona robots yako.txt faira. Dzinogara dzichinzi robots.txt uye dzinogara dzakachengetwa pamudzi we webhusaiti.
- Pakupedzisira, kana mumwe munhu akabatanidza nefaira kana kuti zvinyorwa zvisingabatanidzi ne robots yako.txt faira kubva peji risina kubviswa ne robots.txt faira yavo, injini dzekutsvaga dzingazviwana zvakadaro.
Usashandisa robots.txt mafaira kuti uvanze chero chinhu chinokosha. Pane kudaro, iwe unofanira kuisa ruzivo rwakakosha kumashure kwekuchengetedza mapepa emafaira kana kuisiya kure kwewebhu zvachose.
Mashandisiro Aungaita Aya Mapepa Mafaira
Nyora zvinyorwa kubva muenzaniso unoswedera pedyo kune zvaunoda kuite, uye unamatire mufaira rako re robots.txt. Shandura robot, bhuku, uye mazita mazita kuti uenzane nemasarudzo ako aunoda.
Two Basic Robots.txt Files
User-agent: *
Regai: /
Iyi faira inotaura kuti chero robot (User-agent: *) iyo inosvika iyo inofanira kufuratira peji imwe neimwe panzvimbo ino (Disallow: /).
User-agent: *
Rega:
Iyi faira inoti chero robot (User-agent: *) inosvika iyo inobvumirwa kuona peji imwe neimwe panzvimbo ino (Disallow:).
Iwe unogonawo kuita izvi nekusiya robots yako.txt file isina chakanaka kana kusina imwe pawebsite yako zvachose.
Chengetedza Zvinyorwa Zvitsva Kubva kuRabhoti
User-agent: *
Regai: / cgi-bin /
Regai: / temp /
Iyi faira inotaura kuti chero robot (User-agent: *) inosvika iyo inofanira kufuratira zvinyorwa / cgi-bin / uye / temp / (Disallow: / cgi-bin / Disallow: / temp /).
Chengetedza Mamwe Mapeji Anobva Kumabhoti
User-agent: *
Rega: /jenns-stuff.htm
Rega: /private.php
Iyi faira inotaura kuti chero robot (User-agent: *) inosvika iyo inofanira kufuratira mafaira /jenns-stuff.htm uye /private.php (Disallow: /jenns-stuff.htm Rega: /private.php).
Dzosa Robot Specific kubva Pakusvibisa Nzvimbo Yako
User-agent: Lycos / xx
Regai: /
Iyi faira inotaura kuti Lycos bot (User-agent: Lycos / xx) haibvumirwi kuwana chero kupi paiti yepaiti (Disallow: /).
Bvumira Mumwe Chete Chakanyatsoziva Robot Access
User-agent: *
Regai: /
User-agent: Googlebot
Rega:
Iyi faira inotanga kubvumira mabhoti ose sezvatakaita pamusoro, uye zvinoita kuti Googlebot (User-agent: Googlebot) ave nekwaniso kune zvose (Disallow:).
Gadzirai Mitemo Yakasiyana-siyana Kuti Muwane Zvakananga Izvo Zvisingaiti Zvaunoda
Kunyange zvazvo zviri nani kushandisa shandisi yakanyanya-User-agent, seMushandi-agent: *, unogona kunge wakajeka sezvaunoda. Yeuka kuti marobho akaverenga faira muchirongwa. Saka kana mitsara yekutanga ichitaura kuti mabhoti ose akavharwa kubva pane zvose, uye gare gare mune faira iyo inotaura kuti mabhoti ose anobvumidzwa kuwana chero chinhu, mabhoti achave nekwaniso kwezvose.
Kana iwe usina chokwadi kana wakanyora robots yako.txt faira zvakarurama, unogona kushandisa Google Webmaster Tools kuti uone robots yako.txt faira kana kunyora imwe itsva.