header control

[Join us @ facebook]

I have a strange problem.

Google is crawling so much pages of my site that it is like a DOS attack....

In the first two days of this month, I got more than 15.000 hits from google and the whole requests from crawlers were more than 30.000

So I thought it would be better if I could manipulate the headers, so that the crawlers will not re-index allready indexed pages.

Can you help me to do this?

I use the above code, but it is not working fine :

Code:

<?php
  header("HTTP/1.0 304 Not Modified");
  header("Expires: " . gmdate("D, d M Y H:i:s", ( time() + 31550600 ) ) . " GMT");//For one year
  header("Last-Modified: ". gmdate("D, d M Y H:i:s", $mod ) ." GMT");
?>

the $mod is the timestamp of the last modified date.

[web directory]

That will probably not help straight away as G will only pick it up after reindexing that page... have you removed it from the header now; cause I can't see it in there?

[Join us @ facebook]

I am not sure if I understand what you said (I know my english sucks )

The problem here is that the pages in my site are dynamic.  So every time someone visits a page it gets a header that this page has created now.

Google is visiting my site very often and crawls pages that have allready crawled (that actually haven't expired yet)

With the headers I want to tell Google when to recrawl the page.

[Guest]

[62.885]

Googlebot