22, November 2008

Anyone knows Snapbot? - webmaster forum

 
Webdigity webmaster forums
This forum shares its ad revenue with its members!
[ Home | Help | Search | Forum's Shop | Archive | Login | Register | Webmaster Directory ]
Webdigity Webmaster Forums  >  Web Development  >  Security
Topic: Anyone knows Snapbot?
« previous next »
Pages: [1] Print

Author Topic: Anyone knows Snapbot?  (Read 1527 times)
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8250
42487 credits
Members referred : 3



« on: Jun 06, 2006, 11:43:07 PM »

I just saw the who is online list, and we have 40 guests from the same ip range (38.98.19.XX) with user agent Snapbot/1.0

Does anyone knows this bot?

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy or twitter Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6441
39470 credits
Members referred : 374


It's time to use PHP5!


« Reply #1 on: Jun 07, 2006, 09:49:38 AM »

I have the visitors too,

it's a new search engine: http://www.snap.com/ Visit through proxy

We reviewed the site here at this coomunity...


Last blog : Just a better Internet portal provided by Google
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8250
42487 credits
Members referred : 3



« Reply #2 on: Jun 07, 2006, 12:04:11 PM »

I thought that it might be from snap.com, but I am not really sure.

This is too aggresive to be a legit bot (yesterday we got up to 50 visitors from them at the same time)

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy or twitter Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
Pinoy Webmaster
.com pimp
*****
Gender: Male
Posts: 1126
6048 credits
Members referred : 0


Philippine Beaches


« Reply #3 on: Jun 07, 2006, 12:36:26 PM »

"This is too aggresive to be a legit bot..."

why? do you suspect that this bot is up to something fishy? like what for instance?


Last blog : Santiago Beach, Cebu, Philippines
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8250
42487 credits
Members referred : 3



« Reply #4 on: Jun 07, 2006, 12:39:34 PM »

It could be a spam bot like those who fetch email adresses.

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy or twitter Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6441
39470 credits
Members referred : 374


It's time to use PHP5!


« Reply #5 on: Jun 07, 2006, 12:58:35 PM »

I have regular visits from snapbot, max 10 a day and the IP address range is     66.234.139.xxx


Last blog : Just a better Internet portal provided by Google
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8250
42487 credits
Members referred : 3



« Reply #6 on: Jun 07, 2006, 01:06:01 PM »

Maybe I should ask the snap to see this thread and tell us what they think

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy or twitter Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6441
39470 credits
Members referred : 374


It's time to use PHP5!


« Reply #7 on: Jun 07, 2006, 02:58:38 PM »

Maybe I should ask the snap to see this thread and tell us what they think
sounds like a good idea


Last blog : Just a better Internet portal provided by Google
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8250
42487 credits
Members referred : 3



« Reply #8 on: Jun 07, 2006, 03:01:11 PM »

I have email the company.

I will let you know if they reply my email.

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy or twitter Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8250
42487 credits
Members referred : 3



« Reply #9 on: Jun 07, 2006, 07:01:45 PM »

1st reply :

Quote
Nick,

Yes, that is our bot. It is not malicious. It is just designed to build
an index of the Web for Snap.com.

Thanks for checking in with us and please get back to us if you have any
more questions.

Brad
Snap Customer Service

Now I've asked them regarding the ip ranges that we saw. I will keep you posted on this Smiley

BTW those folks are very good. They replied in only 4 hours.

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy or twitter Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8250
42487 credits
Members referred : 3



« Reply #10 on: Jun 07, 2006, 08:58:30 PM »

Here is the second letter (too fast again Smiley )

Quote
Nick,

Okay, I have some answers for you.

Yes, those are our IPs you are seeing.

The cause of the "aggressiveness" of our crawling is because we are
using multiple servers to do crawling, and while each server has an
adequate delay between requests, at times they may - purely by chance -
get in the same rhythm, and cause multiple requests in a very small time
frame.

We recognize this is a problem and are working on a fix for it right now.

I apologize for the inconvenience. It really is not intended to be
malicious, and we're working to improve our crawler so it does not cause
this problem.

Thanks much for writing, and please write back if you have further
questions.

Brad
Snap Customer Service

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy or twitter Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6441
39470 credits
Members referred : 374


It's time to use PHP5!


« Reply #11 on: Jun 07, 2006, 09:56:19 PM »

good working people (I think Google did the same in the beginning...)


Last blog : Just a better Internet portal provided by Google
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8250
42487 credits
Members referred : 3



« Reply #12 on: Jun 21, 2006, 06:33:25 PM »

Forgot to post you the last email I got which is this :

Quote
Nick,
I’ve been keeping an eye on important incoming user feedback and saw your e-mails, and then visited your forum.

We appreciate your members’ dialog while our “young” indexing systems get their kinks worked out. Your forum members are obviously professionals in this area, and we’re happy to see that even though we may be hitting some site(s) harder than we could be periodically, your community is aware of Snap.com and willing to give our bots the benefit of the doubt for now. As Brad stated, we are aware of this issue and working to resolve it (timeline currently unknown).

I wanted to share with you news about a couple of things you might be interested in. First, we’re working to build a URL submission system where anyone can submit URLs of their web pages, for free, into the Snap Index. This should be live in about 4-6 weeks. I’ll make a personal note to notify you when this goes live (unless you tell me otherwise).

Secondly, as some of your members appear to be familiar with Snap, you might tell them about our “Launch Snap” contest we’re running right now at http://blog.snap.com Visit through proxy . Given that we just launched a major update to the search engine in May, we’re looking for winning ideas on how to promote it – without the resources and budget of the “big guys.” The contest only has a few days left, but we’re giving away $5,000 to the winner (and $5,000 to the referring blog, if applicable), and it might be a worthy cause for someone you know.

I hope my e-mail isn’t unwelcome; I’m not trying to advertise Snap so much as I’m thanking you for administering a friendly and fair forum that’s willing to give Snap, the new kid on the block (and a small company) the fighting chance that we think it deserves.


-Brian
Project Manger, Snap.com

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy or twitter Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6441
39470 credits
Members referred : 374


It's time to use PHP5!


« Reply #13 on: Jun 21, 2006, 10:26:46 PM »

hm... this contest sound like the campaign from the "Echolist Directory" a year ago. I don't wanna compare both with each other but  I didn't like this way of marketing. Because I was not a winner I got nothing. Echolist is getting a lots of links with result no one is using the site and these people getting no visitors from them.

I support at the moment the swickis's from eurekster, why ? because I get lots of visits from them and the swicki pages are very well listed at Google.


Last blog : Just a better Internet portal provided by Google
Bill Gates is my home boy
*****
Gender: Female
Posts: 634
3957 credits
Members referred : 2



« Reply #14 on: Jun 21, 2006, 11:53:37 PM »

I support at the moment the swickis's from eurekster, why ? because I get lots of visits from them and the swicki pages are very well listed at Google.

What is that? Is it something mainly for European sites?

www.yourmessageconsultant.com Visit through proxy, providing online content and printed marketing materials.
www.helpforwebbeginners.com Visit through proxy, Tutorials and how to's for new  webmasters.
www.CraftyTips.com Visit through proxy, a unique Arts & Crafts Directory
www.nocans.com Visit through proxy - Pet Food Recipe Site
www.petsiteguides.com Visit through proxy - A New Pet Directory

Last blog : Hot Glue Failures and Other Turkeys
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6441
39470 credits
Members referred : 374


It's time to use PHP5!


« Reply #15 on: Jun 22, 2006, 12:02:11 AM »



What is that? Is it something mainly for European sites?

it's a US company, check the swicki inside my signature...


Last blog : Just a better Internet portal provided by Google
Trackback URI for this entry : http://www.webdigity.com/trackback.php?topic=2769
Tags : google forums spam Bookmark this thread : Digg Del.icio.us Dzone more....

Topic sponsors:
Get a permanent link here for $1.99!


Pages: [1] Print 
Webdigity Webmaster Forums  >  Web Development  >  Security
Topic: Anyone knows Snapbot?
« previous next »
Jump to:
User Area
Welcome, Guest. Please login or register.
Did you miss your activation email?
Nov 22, 2008, 10:39:06 PM





Login with username, password and session length

Donate to our community, and get a permanent link back to your site!

Donate to our community, and get a permanent link back to your site!


Forum Statistics
Total Posts: 37.741
Total Topics: 7.651
Total Members: 4.398
Tutorials : 56
Resources : 143
Designs : 220
Latest Member: egseopro

38 Guests, 5 Users online :

11 users online today:



Readers

Web Design Gallery · Whois Lookup · Pagerank · Tag Browsing · Lo-fi version · Syndication · Webmaster forum history · Advertise
Developed by HumanWorks © 2005 - 2008 Webdigity webmaster community · sublime directory
Webdigity Webmaster Forums | Powered by SMF 1.0.12. © 2001-2005, Lewis Media. All Rights Reserved.