OMG!I am geek
Posts: 59
350 credits Members referred : 0
« on: Jun 21, 2007, 08:42:12 PM »
Hi.... one question - does it matter if the info for robots is in <head> as <meta name="robots" content="index, follow" /> or in standalone robots.txt file?
What is better?
Global Moderator Community Supporter?
Jedai Sword Master
Gender:
Posts: 6486
39748 credits Members referred : 374
Hi.... one question - does it matter if the info for robots is in <head> as <meta name="robots" content="index, follow" /> or in standalone robots.txt file?
OMG!I am geek
Posts: 59
350 credits Members referred : 0
« Reply #4 on: Jun 21, 2007, 11:00:46 PM »
oh i am not offended at all i am just kinda in hurry... i think it doesnt matter, hopefully Google can find the robots.txt and You got a shorter code . . .
Global Moderator Community Supporter?
Jedai Sword Master
Gender:
Posts: 6486
39748 credits Members referred : 374
oh i am not offended at all i am just kinda in hurry... i think it doesnt matter, hopefully Google can find the robots.txt and You got a shorter code . . .
you the answer yourself:
one file for the whole site or adding the tag to every file
Tim Nash
Global Moderator Community Supporter?
Internet Junkie
Posts: 2173
5036 credits Members referred : 2
Venture Skills - New Media & IT group
« Reply #8 on: Jun 22, 2007, 11:53:38 AM »
robots.txt is the correct location as tags are defined by the version of HTML they are and so may be deprecated, where as the robots.txt is now a recognised standard by search engines however today most engines work with both.