12, October 2008

Google indexed a directory - webmaster forum

 
Webdigity webmaster forums
This forum shares its ad revenue with its members!
[ Home | Help | Search | Forum's Shop | Archive | Login | Register | Webmaster Directory ]
Webdigity Webmaster Forums  >  Web site promotion  >  Search Engine Optimization  >  Google SEO
Topic: Google indexed a directory
« previous next »
Pages: [1] Print

Author Topic: Google indexed a directory  (Read 653 times)
Bill Gates is my home boy
*****
Gender: Female
Posts: 622
3877 credits
Members referred : 2



« on: Mar 13, 2006, 09:31:01 PM »

OK, I had an error on a page (since fixed) and instead of linking to my articles.html page it linked to the articles directory.

Google appears to have followed and indexed that error and now my articles directory shows up on Google.

I fixed the error when I first found it; yet, Googlebot still visited it last night. Just doublechecked the files the bot visited on that cycle and all were correctly coded.

Is this something that will go away on its own, or should I ask Google to remove it? Is it better not to draw attention to it with Google and just leave it? Any thoughts?


www.yourmessageconsultant.com Visit through proxy, providing online content and printed marketing materials.
www.helpforwebbeginners.com Visit through proxy, Tutorials and how to's for new  webmasters.
www.CraftyTips.com Visit through proxy, a unique Arts & Crafts Directory
www.nocans.com Visit through proxy - Pet Food Recipe Site
www.petsiteguides.com Visit through proxy - A New Pet Directory

Last blog : Back to Crafting
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8116
41653 credits
Members referred : 3



« Reply #1 on: Mar 13, 2006, 10:07:39 PM »

Does the page sends a 404 header?

If it does, then propably it would be get out of the index soon, but anyway this should not bother you.

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
Bill Gates is my home boy
*****
Gender: Female
Posts: 622
3877 credits
Members referred : 2



« Reply #2 on: Mar 14, 2006, 06:06:22 AM »

If you follow the link on Google, it brings up the directory and shows the files. Click on any of the files and they are shown correctly as they would appear had they been accessed from the website.

I mainly worry that it could somehow lead to a security problem.

www.yourmessageconsultant.com Visit through proxy, providing online content and printed marketing materials.
www.helpforwebbeginners.com Visit through proxy, Tutorials and how to's for new  webmasters.
www.CraftyTips.com Visit through proxy, a unique Arts & Crafts Directory
www.nocans.com Visit through proxy - Pet Food Recipe Site
www.petsiteguides.com Visit through proxy - A New Pet Directory

Last blog : Back to Crafting
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8116
41653 credits
Members referred : 3



« Reply #3 on: Mar 14, 2006, 11:00:34 AM »

That's a problem.

You should tell your hosting company to deactivate directory browsing in the web server, or use an .htaccess file not found page

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
OMG!I am geek
**
Gender: Male
Posts: 56
374 credits
Members referred : 0



« Reply #4 on: Mar 14, 2006, 11:09:22 AM »

That's very easy to do.

Create a file called .htaccess and open it with a text editor.

Code:

ErrorDocument 404 /404error.php


Then you have to create the page 404error.php and put there your error message.
Bill Gates is my home boy
*****
Gender: Female
Posts: 622
3877 credits
Members referred : 2



« Reply #5 on: Mar 14, 2006, 06:13:51 PM »

I'm not sure I understand. If the page brings up the list how does it cause a 404 file not found error? Isn't it bringing up exactly what was asked for?

www.yourmessageconsultant.com Visit through proxy, providing online content and printed marketing materials.
www.helpforwebbeginners.com Visit through proxy, Tutorials and how to's for new  webmasters.
www.CraftyTips.com Visit through proxy, a unique Arts & Crafts Directory
www.nocans.com Visit through proxy - Pet Food Recipe Site
www.petsiteguides.com Visit through proxy - A New Pet Directory

Last blog : Back to Crafting
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8116
41653 credits
Members referred : 3



« Reply #6 on: Mar 14, 2006, 06:17:12 PM »

No. When the directory browsing is on, the server shows the directory listing, instead of the index file(or the error 404 file).

As an alternative you can add a index.php file in every folder, so it won't be possible to browse the directories of your server.

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
Bill Gates is my home boy
*****
Gender: Female
Posts: 622
3877 credits
Members referred : 2



« Reply #7 on: Mar 14, 2006, 06:20:49 PM »

Index.php? What is that? Would that prove cleaner?

I was thinking of the 404 error page thing, and making it direct to the actual articles page but if someone got a 404 for something else then that might not work so well.

www.yourmessageconsultant.com Visit through proxy, providing online content and printed marketing materials.
www.helpforwebbeginners.com Visit through proxy, Tutorials and how to's for new  webmasters.
www.CraftyTips.com Visit through proxy, a unique Arts & Crafts Directory
www.nocans.com Visit through proxy - Pet Food Recipe Site
www.petsiteguides.com Visit through proxy - A New Pet Directory

Last blog : Back to Crafting
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8116
41653 credits
Members referred : 3



« Reply #8 on: Mar 14, 2006, 06:30:26 PM »

The best solution is to create an html page that will have a little message like "The page you requested does not exist" and some navigation links from your site.

Then do the .htaccess thing.

I will try to rephrase what Thanos said.

Open a text editor (eg. Notepad)

Write this line :

Code:
ErrorDocument 404 /404error.php

Then save this file with the name .htaccess on your root folder of your site.

Then open again the text editor and write the html that you want to displayed when someone is visiting a non existed page.

Save this file with name 404error.php again in the root folder of your site.

You are done Smiley

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
Bill Gates is my home boy
*****
Gender: Female
Posts: 622
3877 credits
Members referred : 2



« Reply #9 on: Mar 14, 2006, 06:35:20 PM »

I think I am getting this better.

I have cPanel and found where I can change the browsing.

It says:

The index manager will allow you to turn indexes on or off for a directory. If indexes are off, people will not be able to see what files are in a directory that lacks an index file.


Does that mean if I turn it off people will still be able to view the files normally, or will it hide them completely? The index file they mention, is that the index.php?

I have a small understanding of the .htaccess file and already have one. Don't quite understand how all the code works; but what I have seems to be doing what it is supposed to be doing. Roll Eyes

Sorry, for the newbie questions, this is my first website where I am responsible for the security too.
« Last Edit: Mar 14, 2006, 06:38:16 PM by YMC »

www.yourmessageconsultant.com Visit through proxy, providing online content and printed marketing materials.
www.helpforwebbeginners.com Visit through proxy, Tutorials and how to's for new  webmasters.
www.CraftyTips.com Visit through proxy, a unique Arts & Crafts Directory
www.nocans.com Visit through proxy - Pet Food Recipe Site
www.petsiteguides.com Visit through proxy - A New Pet Directory

Last blog : Back to Crafting
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8116
41653 credits
Members referred : 3



« Reply #10 on: Mar 14, 2006, 06:40:02 PM »

Quote
Does that mean if I turn it off people will still be able to view the files normally, or will it hide them completely?

People will still be able to see the files that exist. They just wont be able to browse the directory.

Quote
The index file they mention, is that the index.php?

I have never worked with cPanel, but I think that it is not. They propably mean the directory index(the list of files in the directory).

Quote
Sorry, for the newbie questions, this is my first website where I am responsible for the security too.

It's ok. I am glad to help (when possible) because I learned everything by my own, and I know how difficult is this man Smiley

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
Bill Gates is my home boy
*****
Gender: Female
Posts: 622
3877 credits
Members referred : 2



« Reply #11 on: Mar 14, 2006, 06:45:51 PM »

OK, changed the browsing thing in cPanel, now the visitor sees my error page and can still see the stuff they are supposed to.

Have I told you how much I enjoy your forum? Thanks for the help.

I have a fancy education, but Internet was not in existance then (yep, dating myself a bit) so what I know is self taught and from folks like you.

www.yourmessageconsultant.com Visit through proxy, providing online content and printed marketing materials.
www.helpforwebbeginners.com Visit through proxy, Tutorials and how to's for new  webmasters.
www.CraftyTips.com Visit through proxy, a unique Arts & Crafts Directory
www.nocans.com Visit through proxy - Pet Food Recipe Site
www.petsiteguides.com Visit through proxy - A New Pet Directory

Last blog : Back to Crafting
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 8116
41653 credits
Members referred : 3



« Reply #12 on: Mar 14, 2006, 06:49:17 PM »

Quote
Have I told you how much I enjoy your forum? Thanks for the help.

I am glad you do Smiley

About your issue you should do what I mentioned before (the .htaccess thing)

If you have any trouble, let me know Smiley

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : Free Unlimited Bandwith and disk space to good to be true?
Bill Gates is my home boy
*****
Gender: Female
Posts: 622
3877 credits
Members referred : 2



« Reply #13 on: Mar 14, 2006, 06:54:16 PM »

Ahh, now if Google would just drop that entry.

www.yourmessageconsultant.com Visit through proxy, providing online content and printed marketing materials.
www.helpforwebbeginners.com Visit through proxy, Tutorials and how to's for new  webmasters.
www.CraftyTips.com Visit through proxy, a unique Arts & Crafts Directory
www.nocans.com Visit through proxy - Pet Food Recipe Site
www.petsiteguides.com Visit through proxy - A New Pet Directory

Last blog : Back to Crafting
Trackback URI for this entry : http://www.webdigity.com/trackback.php?topic=1779
Tags : google html directories cpanel Bookmark this thread : Digg Del.icio.us Dzone more....

Topic sponsors:
Get a permanent link here for $1.99!


Pages: [1] Print 
Webdigity Webmaster Forums  >  Web site promotion  >  Search Engine Optimization  >  Google SEO
Topic: Google indexed a directory
« previous next »
Jump to:
User Area
Welcome, Guest. Please login or register.
Did you miss your activation email?
Oct 12, 2008, 02:57:41 AM





Login with username, password and session length

Donate to our community, and get a permanent link back to your site!

Donate to our community, and get a permanent link back to your site!


Forum Statistics
Total Posts: 36.906
Total Topics: 7.558
Total Members: 4.150
Tutorials : 56
Resources : 143
Designs : 220
Latest Member: neli67

18 Guests, 4 Users online :

14 users online today:



Readers

Web Design Gallery · Whois Lookup · Pagerank · Tag Browsing · Lo-fi version · Syndication · Webmaster forum history · Advertise
Developed by HumanWorks © 2005 - 2008 Webdigity webmaster community · sublime directory
Webdigity Webmaster Forums | Powered by SMF 1.0.12. © 2001-2005, Lewis Media. All Rights Reserved.