28, May 2012

How can i allow the spiders to crawl my site ... - webmaster forum

 
Webdigity webmaster forums
[ Home | Help | Search | Forum's Shop | Archive | Login | Register | Webmaster Directory ]
Webdigity Webmaster Forums  >  Web site promotion  >  Search Engine Optimization
Topic: How can i allow the spiders to crawl my site ...		 « previous next »
Pages: [1] Print
Instabuck - The easy way to sell digital products online

Author Topic: How can i allow the spiders to crawl my site ...  (Read 684 times)
I wish I was an Oscar winner
**
Posts: 86
858 credits
Members referred : 0
« on: Jul 14, 2011, 08:38:37 am »
I have a site. I have checked the inner page was crawled one month back, usually the page is taking more time to crawl.
OMG!I am geek
**
Posts: 54
358 credits
Members referred : 0
« Reply #1 on: Jul 14, 2011, 01:36:03 pm »
For improving the crawler's visit frequency on your website
- Submit your Sitemap to google webmaster tools
- Get backlinks from popular blogs which frequently get crawled
- Ping the search engines regularly
Bill Cosby is my Father
*
Posts: 4
30 credits
Members referred : 0
« Reply #2 on: Jul 15, 2011, 06:20:19 am »
Hey!! Rebeca
Thanks for the tips. But I want to ask what is Sitemap ?
Metal slug addict
*
Posts: 19
136 credits
Members referred : 0
« Reply #3 on: Jul 15, 2011, 01:36:27 pm »
you can set the crawl rate from google master, please check it. from there you can learn alot of things.
Metal slug addict
*
Posts: 19
114 credits
Members referred : 0
« Reply #4 on: Jul 18, 2011, 02:08:32 pm »

You have to change your meta tag like
<meta name="robots" content="index, follow" />

<meta name="revisit-after" content="3 Days" />
Then after you ? ping your site ? through ? pingomatic ? any other sites. defiantly your site crawing rate is increase.

OMG!I am geek
**
Posts: 54
358 credits
Members referred : 0
« Reply #5 on: Aug 03, 2011, 01:38:57 pm »
Quote from: DuncanCox on Jul 15, 2011, 06:20:19 am
Hey!! Rebeca
Thanks for the tips. But I want to ask what is Sitemap ?
There are two types of sitemaps - html (for human visitors) and xml (for search engines). In my post, I was talking about XML sitemaps...though both are equally important. An XML is a well-structured collection of URLs of your web-pages.

An XML sitemap:
- Ensures better visibility by search engines
- Enables you to rely less on external links that will bring search engines to your site.
- Helps with broken internal links or orphaned pages that cannot be reached in other way
- Alerts search engines to any changes/additions to your site
- Helps you choose pages that you don???t want to index
Spy Agent
***
Gender: Male
Posts: 112
692 credits
Members referred : 0
« Reply #6 on: Aug 19, 2011, 09:09:12 am »
Continue with some small changes in the website so that search engine could crawl your website more fast.
My Name is Enigo Montoya
*
Posts: 32
204 credits
Members referred : 0
« Reply #7 on: Sep 23, 2011, 07:38:25 am »
If you want your webpages to be crawled by Search engine spiders, You should not robots.txt file, and also do off page submissions for frequent crawling, If not update your web pages content.
Raped By Google
*
Posts: 28
216 credits
Members referred : 0
« Reply #8 on: Sep 26, 2011, 03:16:53 pm »
Google is a fully automated search engine that uses software known as "spiders" to crawl the web on a regular basis and find sites to add to our index.

Create sitemap - it will help to get indexed in Google.
My name is Bong, James Bong
*
Posts: 10
60 credits
Members referred : 0

http://www.highave.com
« Reply #9 on: Oct 10, 2011, 08:47:44 am »
submit your site on google site map, book mark with some high pr do follow bookmarking sites.
Trackback URI for this entry : http://www.webdigity.com/trackback.php?topic=13018
Tags : seo Bookmark this thread : Digg Del.icio.us Dzone more....

Pages: [1] Print 
Webdigity Webmaster Forums  >  Web site promotion  >  Search Engine Optimization
Topic: How can i allow the spiders to crawl my site ...		 « previous next »
Jump to:
User Area
Welcome, Guest. Please login or register.
Did you miss your activation email?
May 28, 2012, 04:03:15 am





Login with username, password and session length

Donate to our community, and get a permanent link back to your site!

Donate to our community, and get a permanent link back to your site!


Forum Statistics
Total Posts: 62.814
Total Topics: 11.028
Total Members: 21.451
Tutorials : 58
Resources : 929
Designs : 395
Latest Member: sobbin

112 Guests, 3 Users online :

12 users online today:

Recent topics
Re: How to
Is the Website Review Secti...
Re: Bing adds features to b...
Re: Google docs, connected ...
Google Chrome Crashes on so...
So.CL Microsoft's new Socia...
Which was your favorite Dis...
Re: Favorite cartoon as a k...

HumanWorks Network
Technology news
Webmaster articles
Sublime web directory
RSS Feed directory and viewer


Web Design Gallery · Whois Lookup · Pagerank · Tag Browsing · Lo-fi version · Syndication · Webmaster forum history · Advertise
Developed by HumanWorks © 2005 - 2012 Webdigity webmaster community · sublime directory
Webdigity Webmaster Forums | Powered by SMF 1.0.12. © 2001-2005, Lewis Media. All Rights Reserved.