28, May 2012

Crawlable pages and non crawlable pages - webmaster forum

 
Webdigity webmaster forums
[ Home | Help | Search | Forum's Shop | Archive | Login | Register | Webmaster Directory ]
Webdigity Webmaster Forums  >  Web site promotion  >  Search Engine Optimization  >  Google SEO
Topic: Crawlable pages and non crawlable pages
« previous next »
Pages: [1] Print
Instabuck - The easy way to sell digital products online

Author Topic: Crawlable pages and non crawlable pages  (Read 3367 times)
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« on: Sep 18, 2005, 12:23:33 pm »

A lot of people ask me how they can have all their pages indexed by Google, and how Google crawler decides to index or not a page.

Well you can find answers to these questions here, but I will also try to explain some things.

The g spider don't like sessions. So if you have a page with a variable like ?sessid=...... it would propably not get indexed. ( eg. url.com/index.php?sessionid=2 )

Also urls with a variable called id plus other variables wont get indexed ( eg. url.com/index.php?id=2&something=1 )

That's all. If you do this, the g bot will crawl the whole of your site.

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
He's The Man
Novice Spammer
***
Gender: Male
Posts: 100
0 credits
Members referred : 0



« Reply #1 on: Sep 18, 2005, 04:22:30 pm »

Sad I have sessions in my page links

for example..
http://www.mozunk.com/index.php?m=browse

How would you change this? My partner who did all the php set it up like that so I will need to tell him.
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #2 on: Sep 18, 2005, 09:01:49 pm »

Those variables are not session.

I took a look to your site, and it has very well optimized urls.

They can be full indexed, and actually there are allready indexed 15600 pages of your site at Google

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Novice Spammer
***
Gender: Female
Posts: 101
0 credits
Members referred : 0



« Reply #3 on: Sep 19, 2005, 01:20:27 am »

I remember reading in Sitepoint that urls with variables can be indexed- are there any information regarding this?
Novice Spammer
***
Gender: Male
Posts: 100
346 credits
Members referred : 0



« Reply #4 on: Sep 19, 2005, 02:37:22 am »

Thats some good info, thanks. I have to take notes on all of this stuff for when I create my next site Smiley
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #5 on: Sep 19, 2005, 10:38:56 am »

I remember reading in Sitepoint that urls with variables can be indexed- are there any information regarding this?

The most official information on this can be found at the Google guidelines for webmasters

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Trackback URI for this entry : http://www.webdigity.com/trackback.php?topic=371
Tags : php google Bookmark this thread : Digg Del.icio.us Dzone more....

Pages: [1] Print 
Webdigity Webmaster Forums  >  Web site promotion  >  Search Engine Optimization  >  Google SEO
Topic: Crawlable pages and non crawlable pages
« previous next »
Jump to:
User Area
Welcome, Guest. Please login or register.
Did you miss your activation email?
May 28, 2012, 07:40:41 pm





Login with username, password and session length

Donate to our community, and get a permanent link back to your site!

Donate to our community, and get a permanent link back to your site!






Web Design Gallery · Whois Lookup · Pagerank · Tag Browsing · Lo-fi version · Syndication · Webmaster forum history · Advertise
Developed by HumanWorks © 2005 - 2012 Webdigity webmaster community · sublime directory
Webdigity Webmaster Forums | Powered by SMF 1.0.12. © 2001-2005, Lewis Media. All Rights Reserved.