wineo
Fri 14 April 2006, 06:04 am GMT +0200
I have a script on my error404 page that emails me the file that was not found, the referring page and the user agent that requested the file. Recently I have been receiving the following messages:
So there is no referring page... obviously because it is the google bot, but my question is this... Why is the google bot adding the external link to the site domain with single quotes around it? I presume that the bot sees <a href='...' >, with single quotes and for some reason is adding the link to the main site link and trying to see if that page exists. I have changed as manu links as possible to <a href="..." > now so that there are double quotes aroung the url to try and prevent this.
Anyone have any idea why this bot is behaving like this? ???
Quote
File not found: www. site .com/'http: //www. link .com' [no spaces obviously]
Refering page:
User agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Refering page:
User agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
So there is no referring page... obviously because it is the google bot, but my question is this... Why is the google bot adding the external link to the site domain with single quotes around it? I presume that the bot sees <a href='...' >, with single quotes and for some reason is adding the link to the main site link and trying to see if that page exists. I have changed as manu links as possible to <a href="..." > now so that there are double quotes aroung the url to try and prevent this.
Anyone have any idea why this bot is behaving like this? ???