I am a metal monkey!
Administrator Community Supporter?
Jedai Sword Master
Gender:
Posts: 8250
42487 credits Members referred : 3
« Reply #10 on: Jun 07, 2006, 08:58:30 PM »
Here is the second letter (too fast again )
Quote
Nick,
Okay, I have some answers for you.
Yes, those are our IPs you are seeing.
The cause of the "aggressiveness" of our crawling is because we are using multiple servers to do crawling, and while each server has an adequate delay between requests, at times they may - purely by chance - get in the same rhythm, and cause multiple requests in a very small time frame.
We recognize this is a problem and are working on a fix for it right now.
I apologize for the inconvenience. It really is not intended to be malicious, and we're working to improve our crawler so it does not cause this problem.
Thanks much for writing, and please write back if you have further questions.
I am a metal monkey!
Administrator Community Supporter?
Jedai Sword Master
Gender:
Posts: 8250
42487 credits Members referred : 3
« Reply #12 on: Jun 21, 2006, 06:33:25 PM »
Forgot to post you the last email I got which is this :
Quote
Nick, I’ve been keeping an eye on important incoming user feedback and saw your e-mails, and then visited your forum.
We appreciate your members’ dialog while our “young” indexing systems get their kinks worked out. Your forum members are obviously professionals in this area, and we’re happy to see that even though we may be hitting some site(s) harder than we could be periodically, your community is aware of Snap.com and willing to give our bots the benefit of the doubt for now. As Brad stated, we are aware of this issue and working to resolve it (timeline currently unknown).
I wanted to share with you news about a couple of things you might be interested in. First, we’re working to build a URL submission system where anyone can submit URLs of their web pages, for free, into the Snap Index. This should be live in about 4-6 weeks. I’ll make a personal note to notify you when this goes live (unless you tell me otherwise).
Secondly, as some of your members appear to be familiar with Snap, you might tell them about our “Launch Snap” contest we’re running right now at http://blog.snap.com . Given that we just launched a major update to the search engine in May, we’re looking for winning ideas on how to promote it – without the resources and budget of the “big guys.” The contest only has a few days left, but we’re giving away $5,000 to the winner (and $5,000 to the referring blog, if applicable), and it might be a worthy cause for someone you know.
I hope my e-mail isn’t unwelcome; I’m not trying to advertise Snap so much as I’m thanking you for administering a friendly and fair forum that’s willing to give Snap, the new kid on the block (and a small company) the fighting chance that we think it deserves.
Global Moderator Community Supporter?
Jedai Sword Master
Gender:
Posts: 6441
39470 credits Members referred : 374
It's time to use PHP5!
« Reply #13 on: Jun 21, 2006, 10:26:46 PM »
hm... this contest sound like the campaign from the "Echolist Directory" a year ago. I don't wanna compare both with each other but I didn't like this way of marketing. Because I was not a winner I got nothing. Echolist is getting a lots of links with result no one is using the site and these people getting no visitors from them.
I support at the moment the swickis's from eurekster, why ? because I get lots of visits from them and the swicki pages are very well listed at Google.
I support at the moment the swickis's from eurekster, why ? because I get lots of visits from them and the swicki pages are very well listed at Google.
What is that? Is it something mainly for European sites?