Crawlable pages and non crawlable pages

[Join us @ facebook]

A lot of people ask me how they can have all their pages indexed by Google, and how Google crawler decides to index or not a page.

Well you can find answers to these questions here , but I will also try to explain some things.

The g spider don't like sessions. So if you have a page with a variable like ?sessid=...... it would propably not get indexed. ( eg. url.com/index.php?sessionid=2 )

Also urls with a variable called id plus other variables wont get indexed ( eg. url.com/index.php?id=2&something=1 )

That's all. If you do this, the g bot will crawl the whole of your site.

I have sessions in my page links

for example..
http://www.mozunk.com/index.php?m=browse

How would you change this? My partner who did all the php set it up like that so I will need to tell him.

[Join us @ facebook]

Those variables are not session.

I took a look to your site, and it has very well optimized urls.

They can be full indexed, and actually there are allready indexed 15600 pages of your site at Google

I remember reading in Sitepoint that urls with variables can be indexed- are there any information regarding this?

Thats some good info, thanks. I have to take notes on all of this stuff for when I create my next site

[Join us @ facebook]

I remember reading in Sitepoint that urls with variables can be indexed- are there any information regarding this?

The most official information on this can be found at the Google guidelines for webmasters

[Guest]

[36.302]

Googlebot, Yahoo crawler, Baidu Spider, Gigabot