10, January 2009

Crawling - webmaster forum

 
Webdigity webmaster forums
This forum shares its ad revenue with its members!
[ Home | Help | Search | Forum's Shop | Archive | Login | Register | Webmaster Directory ]
Webdigity Webmaster Forums  >  WebDigity Community  >  HumanWorks network news & feedback
Topic: Crawling		 « previous next »
Pages: [1] Print

Author Topic: Crawling  (Read 721 times)
World Wide Whale
***
Gender: Female
Posts: 151
660 credits
Members referred : 0
« on: Feb 19, 2006, 05:08:03 PM »
Just wondering, but how often do your spiders crawl for The Topsites?

~Crystal
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8363
43165 credits
Members referred : 3
« Reply #1 on: Feb 19, 2006, 06:52:55 PM »
If you are talking for the cache crawler, it is crawling 1-2 times per week.
Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy or twitter Visit through proxy

Last blog : Monetizing Old Posts
World Wide Whale
***
Gender: Female
Posts: 151
660 credits
Members referred : 0
« Reply #2 on: Feb 19, 2006, 08:40:23 PM »
Ah, okay. Thanks.

~Crystal
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8363
43165 credits
Members referred : 3
« Reply #3 on: Feb 19, 2006, 08:54:50 PM »
You are welcome Smiley
Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy or twitter Visit through proxy

Last blog : Monetizing Old Posts
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8363
43165 credits
Members referred : 3
« Reply #4 on: Feb 20, 2006, 05:57:35 PM »
BTW a cache crawling is done right now.
Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy or twitter Visit through proxy

Last blog : Monetizing Old Posts
Cyberpunk Wannabe
*
Posts: 38
256 credits
Members referred : 0
« Reply #5 on: Feb 22, 2006, 12:06:05 PM »
Is this crawling job done by a free script or is it custom coded?
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8363
43165 credits
Members referred : 3
« Reply #6 on: Feb 22, 2006, 12:12:20 PM »
No it is developed by me.
Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy or twitter Visit through proxy

Last blog : Monetizing Old Posts
Trackback URI for this entry : http://www.webdigity.com/trackback.php?topic=1549
Bookmark this thread : Digg Del.icio.us Dzone more....

Pages: [1] Print 
Webdigity Webmaster Forums  >  WebDigity Community  >  HumanWorks network news & feedback
Topic: Crawling		 « previous next »
Jump to:
User Area
Welcome, Guest. Please login or register.
Did you miss your activation email?
Jan 10, 2009, 03:28:00 AM





Login with username, password and session length

Donate to our community, and get a permanent link back to your site!

Donate to our community, and get a permanent link back to your site!


Forum Statistics
Total Posts: 38.670
Total Topics: 7.775
Total Members: 4.665
Tutorials : 56
Resources : 143
Designs : 220
Latest Member: mosesbradford

22 Guests, 3 Users online :

15 users online today:

Recent topics
Accessing user data without...
PHP4 script to stop pop-ups...
Re: Qoutes for the day Thre...
Re: Yes or no game! Do you ...
Are there any Dayana Host c...
Re: Your Favorite Car? ...
Re: New year resolutions...
Re: HI

HumanWorks Network
Technology news
Webmaster articles
Sublime web directory
RSS Feed directory and viewer

Readers

Web Design Gallery · Whois Lookup · Pagerank · Tag Browsing · Lo-fi version · Syndication · Webmaster forum history · Advertise
Developed by HumanWorks © 2005 - 2009 Webdigity webmaster community · sublime directory
Webdigity Webmaster Forums | Powered by SMF 1.0.12. © 2001-2005, Lewis Media. All Rights Reserved.