søndag, februar 13, 2005

Robot.txt fil

Robot.txt fil
En optimering af en hjemmeside indbefatter brugen af en robot.txt fil
som de fleste webdesignere glemmer at implementere.

En robot.txt fil er vigtig for din side, fordi du på den måde fortæller
en crawler, en robot (googlebot) hvad den kan og ikke kan tage med i sit index.
Du kan på den måde spærre af for mapper som admin eller stat.

Liste med variabler som kan være i en robot.txt fil og deres betydning.

* User-agent:
Her beskrives den enkelte robot og adgangs procedure
eller tegnet "*" for alle robotter.

* Disallow:
Her beskrives hvilke filer og mapper der skal udelades under et crawl.

* #
Tegnet repræsenterer en kommentar.

Eksempler på robot.txt fil.

User-agent: *
Disallow:
Betydnigen her fortæller at der er fri adgang til hele indholdet.


User-agent: *
Disallow: /cgi-bin/
Denne beder en robot om at udelade "cgi-bin directory" mappen.


User-agent: googlebot
Disallow:

User-agent: *
Disallow: /admin.php
Disallow: /cgi-bin/
Disallow: /admin/
Disallow: /stats/

I dette eksempel er der fri adgang for googlebot til alle filer
og mapper medens det gælder for alle andre robotter om at
udelade filer som admin.php, cgi-bin, admin, stats mapperne.
Søgemaskineoptimering »

5 Comments:

Anonymous Anonym said...

I must be missing something with the whole pagerank thing. I mean, if I go after a keyword, and I get it to the top position in the search engines, why should I care at all about the pr that is going to show in the google bar. It shouldn't matter at all, to anyone. After all, the whole point is to grab those top positions, and you can do that just fine without having high google pr.

9:38 PM  
Anonymous Increased Pagerank said...

Hi Kim Anton, I found your blog while searching for the latest blog news covering Page Rank, and although Robot.txt fil isn't a perfect match to what I am looking for, I certainly like the look and feel of your blog.

2:25 PM  
Anonymous Page Rank said...

Hey Kim Anton, Your Robot.txt fil message is well received. I am just out searching for information on SEM and related and ended up on your blog. Although I'm not an avid "blogger", I have decided to save yours and come back since the information provided has substance.

8:52 PM  
Anonymous #1 in Google said...

Top Position Fast was actually the information I was looking for when I found your blog. Robot.txt fil is certainly a great topic Kim Anton... Are you interested in trading links between our sites?

2:37 AM  
Anonymous Anonym said...

Submit your Articles to this new article content cooking submit. article content cooking submit

9:12 AM  

Send en kommentar

<< Home