Bots?

How many bots have visited your site?  I'm at 20 bots right now.  Google and MSN seem to be competing to see how much bandwith each bot can use.   

Even though its just a static page saying I will be back in 2006 I have 5 bots crawling the site.

I've had a few odd ones like "larbin" or psbot.

Baidu shows up almost daily now, odd for a site like mine.

I have only seen Ask Jeeves crawling my site, and it only stays for a second before hes gone.

Google hasn't even started eating my forum yet. I guess it will get around to it sooner or later.

I have only seen Ask Jeeves crawling my site, and it only stays for a second before hes gone.

Google hasn't even started eating my forum yet. I guess it will get around to it sooner or later.

Your site has session ids for guests.  Google will not do much of a crawl on your site if you have SIDs on your site.  Try to find a mod to get rid of them.

I have only seen Ask Jeeves crawling my site, and it only stays for a second before hes gone.

Google hasn't even started eating my forum yet. I guess it will get around to it sooner or later.

If you have a forum, make sure to apply SEO mods that will make HTML pages for every thread. Making a sitemap AND getting a few links on other websites pointing to your website will do the trick.

Make sure google knows where you are, and make sure to update the content often so google crawls you more often.

Google now crawls about 200 pages a day on my forum...

Ask Jeeves on the other hand still doesn't do jack.

[Join us @ facebook]

My though on this topic, is that you should not worry if a bot is visiting your site, or how often does it visit it, because this is a matter of time.

If you have lots of incoming links (directory submittions, link exchanges ) and you update your content often, then you are in the right way.

From my experience, I think that when a site gets pagerank 4, the robots will index it very fast.

I usually have no more than 5 bots at a time viewing my site.

I have had google and ask jeeves visit my forums (not opened yet) a few hundred times a month.

Googlebot || 47 504.49 KB || 02 Mar 2006 - 23:09
Inktomi Slurp || 25 || 300.71 KB || 02 Mar 2006 - 23:01
MSNBot || 12 || 135.59 KB || 02 Mar 2006 - 14:26
Unknown robot (identified by 'spider') || 3 28.09 KB || 02 Mar 2006 - 10:32
AskJeeves || 1 || 10.97 KB || 02 Mar 2006 - 06:11
Unknown robot (identified by 'crawl') || 1|| 0KB || 02 Mar 2006 - 10:33

The name of the bot/crawler/whatever || htis || bandwidth used || Last Visit

~Crystal

[Guest]

[37.740]

Googlebot, Yahoo crawler, Baidu Spider, Msnbot