12, October 2008

Crawling - webmaster forum

 
Webdigity webmaster forums
This forum shares its ad revenue with its members!
[ Home | Help | Search | Forum's Shop | Archive | Login | Register | Webmaster Directory ]
Webdigity Webmaster Forums  >  WebDigity Community  >  HumanWorks network news & feedback
Topic: Crawling		 « previous next »
Pages: [1] Print

Author Topic: Crawling  (Read 665 times)
World Wide Whale
***
Gender: Female
Posts: 151
660 credits
Members referred : 0
« on: Feb 19, 2006, 05:08:03 PM »
Just wondering, but how often do your spiders crawl for The Topsites?

~Crystal
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8119
41671 credits
Members referred : 3
« Reply #1 on: Feb 19, 2006, 06:52:55 PM »
If you are talking for the cache crawler, it is crawling 1-2 times per week.
Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
World Wide Whale
***
Gender: Female
Posts: 151
660 credits
Members referred : 0
« Reply #2 on: Feb 19, 2006, 08:40:23 PM »
Ah, okay. Thanks.

~Crystal
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8119
41671 credits
Members referred : 3
« Reply #3 on: Feb 19, 2006, 08:54:50 PM »
You are welcome Smiley
Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8119
41671 credits
Members referred : 3
« Reply #4 on: Feb 20, 2006, 05:57:35 PM »
BTW a cache crawling is done right now.
Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
Cyberpunk Wannabe
*
Posts: 38
256 credits
Members referred : 0
« Reply #5 on: Feb 22, 2006, 12:06:05 PM »
Is this crawling job done by a free script or is it custom coded?
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8119
41671 credits
Members referred : 3
« Reply #6 on: Feb 22, 2006, 12:12:20 PM »
No it is developed by me.
Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
Trackback URI for this entry : http://www.webdigity.com/trackback.php?topic=1549
Bookmark this thread : Digg Del.icio.us Dzone more....

Pages: [1] Print 
Webdigity Webmaster Forums  >  WebDigity Community  >  HumanWorks network news & feedback
Topic: Crawling		 « previous next »
Jump to:
User Area
Welcome, Guest. Please login or register.
Did you miss your activation email?
Oct 12, 2008, 08:55:47 PM





Login with username, password and session length

Donate to our community, and get a permanent link back to your site!

Donate to our community, and get a permanent link back to your site!


Forum Statistics
Total Posts: 36.924
Total Topics: 7.559
Total Members: 4.152
Tutorials : 56
Resources : 143
Designs : 220
Latest Member: applemobile

29 Guests, 7 Users online :

11 users online today:

Recent topics
Hi to all
Re: having two different do...
Re: Open linking community...
Re: What will you do to get...
Re: Need your advice on com...
Re: SSL certificate
Re: Google Apps for Mail vs...
Re: Website Promotion...

HumanWorks Network
Technology news
Webmaster articles
Sublime web directory
RSS Feed directory and viewer

Readers

Web Design Gallery · Whois Lookup · Pagerank · Tag Browsing · Lo-fi version · Syndication · Webmaster forum history · Advertise
Developed by HumanWorks © 2005 - 2008 Webdigity webmaster community · sublime directory
Webdigity Webmaster Forums | Powered by SMF 1.0.12. © 2001-2005, Lewis Media. All Rights Reserved.