28, May 2012

strange url used by Yahoo slurp - webmaster forum

 
Webdigity webmaster forums
[ Home | Help | Search | Forum's Shop | Archive | Login | Register | Webmaster Directory ]
Webdigity Webmaster Forums  >  Web site promotion  >  Search Engine Optimization
Topic: strange url used by Yahoo slurp
« previous next »
Pages: [1] Print
Instabuck - The easy way to sell digital products online

Author Topic: strange url used by Yahoo slurp  (Read 2274 times)
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« on: Jul 03, 2006, 11:07:11 pm »

Hello,

every day my webserver is logging some visits from you yahoo bot like:

/index.php?sid=efc31f437257a8c34ea8879149292964

the query string is never used on my site, anyone an idea how this is happend?

I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #1 on: Jul 04, 2006, 10:30:33 am »

It is propably one of the many exploit bots that use fake user agent headers.

Try to identify it from the ip, and you will propably see requests to other pages that don't exist at all.

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« Reply #2 on: Jul 04, 2006, 10:44:57 am »

It is propably one of the many exploit bots that use fake user agent headers.

Try to identify it from the ip, and you will propably see requests to other pages that don't exist at all.

all IP's are from the same range (72.30.xxx.xxx and 68.142.xxx.xxx) both are from inktomi (yahoo)

I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #3 on: Jul 04, 2006, 11:03:57 am »

Then propably your host had auto append session ids before some time and yahoo grabed this.

Just redirect those pages and it will be fine.

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« Reply #4 on: Jul 04, 2006, 11:09:28 am »

Then propably your host had auto append session ids before some time and yahoo grabed this.

Just redirect those pages and it will be fine.
strange is that these url's are not indexed by yahoo, I think its a query string from external links.

Rewriting the url wil fix this? (I think that refering URL provides the problem...)

I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #5 on: Jul 04, 2006, 11:15:15 am »

It will propably fix this.

Yahoo will continue to crawl the page, but as there will be a permanent redirect it wont index it.

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Trackback URI for this entry : http://www.webdigity.com/trackback.php?topic=3124
Tags : yahoo Bookmark this thread : Digg Del.icio.us Dzone more....

Pages: [1] Print 
Webdigity Webmaster Forums  >  Web site promotion  >  Search Engine Optimization
Topic: strange url used by Yahoo slurp
« previous next »
Jump to:
User Area
Welcome, Guest. Please login or register.
Did you miss your activation email?
May 28, 2012, 01:48:57 pm





Login with username, password and session length

Donate to our community, and get a permanent link back to your site!

Donate to our community, and get a permanent link back to your site!






Web Design Gallery · Whois Lookup · Pagerank · Tag Browsing · Lo-fi version · Syndication · Webmaster forum history · Advertise
Developed by HumanWorks © 2005 - 2012 Webdigity webmaster community · sublime directory
Webdigity Webmaster Forums | Powered by SMF 1.0.12. © 2001-2005, Lewis Media. All Rights Reserved.