Robots.txt eshte ajo cfare perdorin ata qe posedojne faqe interneti (web owners) per tu thene instruksione roboteve te webit rreth sitit te tyre. Me ane te robots.txt ju ndalon roboteve te tjere qe te mos kene te drejte hyrjere ne faqet e web-it tend.
Vendndodhja e robots.txt eshte ne kete forme: http://meso-tech.blogspot.com/robots.txt (www.mydomain.com/robots.txt) dhe kjo eshte e dukshme per cdokend, ne qofte se mundohesh te fshehesh informacion duke perdorur robots.txt nuk ke per tja arritur.
Robots.txt e paracaktuar per blogjet ne blogger eshte ne kete forme:
User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Allow: /
Gjithashtu mund te azhornosh nje sitemap te blogut tend nepermjet robots.txt
Per te aktivizuar robots.txt ne blogun tend ndiq keto instruksione:
1. Hyr me llogarine tende ne blogger
2. Shko tek seksioni "Settings", pastaj tek "Search preferences" dhe shiko poshte ne te djathe, "Crawlers and indexing"
3. Shiko tek "Custom robots.txt" dhe kliko ne ikonen "Edit"
4.Pasi ta hapesh shkruaj kte text aty brenda:
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://blogu-yt.blogspot.com/feeds/posts/default?orderby=UPDATED
(blogu-yt zevendesoje me linkun e blogut tend)
0 comments:
Post a Comment