28, May 2012

Crawling - webmaster forum

 
Webdigity webmaster forums
[ Home | Help | Search | Forum's Shop | Archive | Login | Register | Webmaster Directory ]
Webdigity Webmaster Forums  >  WebDigity Community  >  HumanWorks network news & feedback
Topic: Crawling
« previous next »
Pages: [1] Print
Instabuck - The easy way to sell digital products online

Author Topic: Crawling  (Read 1188 times)
World Wide Whale
***
Gender: Female
Posts: 151
660 credits
Members referred : 0



« on: Feb 19, 2006, 04:08:03 pm »

Just wondering, but how often do your spiders crawl for The Topsites?

~Crystal
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #1 on: Feb 19, 2006, 05:52:55 pm »

If you are talking for the cache crawler, it is crawling 1-2 times per week.

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
World Wide Whale
***
Gender: Female
Posts: 151
660 credits
Members referred : 0



« Reply #2 on: Feb 19, 2006, 07:40:23 pm »

Ah, okay. Thanks.

~Crystal
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #3 on: Feb 19, 2006, 07:54:50 pm »

You are welcome Smiley

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #4 on: Feb 20, 2006, 04:57:35 pm »

BTW a cache crawling is done right now.

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Cyberpunk Wannabe
*
Posts: 38
256 credits
Members referred : 0



« Reply #5 on: Feb 22, 2006, 11:06:05 am »

Is this crawling job done by a free script or is it custom coded?
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #6 on: Feb 22, 2006, 11:12:20 am »

No it is developed by me.

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Trackback URI for this entry : http://www.webdigity.com/trackback.php?topic=1549
Bookmark this thread : Digg Del.icio.us Dzone more....

Pages: [1] Print 
Webdigity Webmaster Forums  >  WebDigity Community  >  HumanWorks network news & feedback
Topic: Crawling
« previous next »
Jump to:
User Area
Welcome, Guest. Please login or register.
Did you miss your activation email?
May 28, 2012, 09:09:26 am





Login with username, password and session length

Donate to our community, and get a permanent link back to your site!

Donate to our community, and get a permanent link back to your site!


Forum Statistics
Total Posts: 62.853
Total Topics: 11.033
Total Members: 21.458
Tutorials : 58
Resources : 929
Designs : 395
Latest Member: golamkayes

134 Guests, 3 Users online :

22 users online today:




Web Design Gallery · Whois Lookup · Pagerank · Tag Browsing · Lo-fi version · Syndication · Webmaster forum history · Advertise
Developed by HumanWorks © 2005 - 2012 Webdigity webmaster community · sublime directory
Webdigity Webmaster Forums | Powered by SMF 1.0.12. © 2001-2005, Lewis Media. All Rights Reserved.