28, May 2012

you are being scraped by a proxy - webmaster forum

 
Webdigity webmaster forums
[ Home | Help | Search | Forum's Shop | Archive | Login | Register | Webmaster Directory ]
Webdigity Webmaster Forums  >  WebDigity Community  >  Forum Lounge
Topic: you are being scraped by a proxy
« previous next »
Pages: [1] 2 Print
Instabuck - The easy way to sell digital products online

Author Topic: you are being scraped by a proxy  (Read 3053 times)
Nikolas' Servant's Servant
*
Gender: Male
Posts: 29
186 credits
Members referred : 0


Working hard to build in PHP


« on: Jul 16, 2007, 11:43:40 am »

Did you guys know you are being scraped by a proxy?

myspace--proxy.com/nph-proxy.cgi/010110A/http/www.webdigity.com
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« Reply #1 on: Jul 16, 2007, 11:46:08 am »

Did you guys know you are being scraped by a proxy?

myspace--proxy.com/nph-proxy.cgi/010110A/http/www.webdigity.com

and do you think that is bad? Smiley

Google will remove this links after a while...

I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #2 on: Jul 16, 2007, 11:49:32 am »

BTW I own this proxy site Smiley

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Tim Nash
Global Moderator
Community Supporter ?
Internet Junkie
*****
Posts: 2175
5052 credits
Members referred : 2


Venture Skills - New Media & IT group


« Reply #3 on: Jul 16, 2007, 11:49:42 am »

I guess its time to add some really large movie files then and point our traffic at the proxy Wink

Would you like to be an SEO, let me help with, The Tim Nash introduction to SEO alternatively for Social media optimisation take a look at the Venture Skills Blog

Last blog : Its all in the mp3s
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« Reply #4 on: Jul 16, 2007, 11:51:17 am »

BTW I own this proxy site Smiley

hehe...

Nikolas' Servant's Servant
*
Gender: Male
Posts: 29
186 credits
Members referred : 0


Working hard to build in PHP


« Reply #5 on: Jul 16, 2007, 12:00:14 pm »

Nik scraper yourself-->

Be careful, Google does not like such things.
But you only doing one page so should be ok.
When I was building my business site I did not disallow because I wanted to test the template for indexing, and Google caught me, and took the proxy out of the index and penalized the authoritative domain.
I had to use Google url removal to clean up the shit.
Nikolas' Servant's Servant
*
Gender: Male
Posts: 29
186 credits
Members referred : 0


Working hard to build in PHP


« Reply #6 on: Jul 16, 2007, 12:01:31 pm »

Don't you guys ever sleep?
When ever I com here Nik and olaf are on the board.
Tim Nash
Global Moderator
Community Supporter ?
Internet Junkie
*****
Posts: 2175
5052 credits
Members referred : 2


Venture Skills - New Media & IT group


« Reply #7 on: Jul 16, 2007, 12:04:49 pm »

no we the moderators were replaced by robots it has gone unnoticed for nearly a half a year now we must kill you with a spoon....

Would you like to be an SEO, let me help with, The Tim Nash introduction to SEO alternatively for Social media optimisation take a look at the Venture Skills Blog

Last blog : Its all in the mp3s
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #8 on: Jul 16, 2007, 12:05:14 pm »

Don't you guys ever sleep?
When ever I com here Nik and olaf are on the board.

LOL, we sleep Smiley

We are just a little addictive to this community Smiley

BTW what is the problem with proxies? I don't understand what exactly you mean.

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« Reply #9 on: Jul 16, 2007, 12:06:54 pm »

hehe I have proxy links for the while ODP directory

Cheesy

Nikolas' Servant's Servant
*
Gender: Male
Posts: 29
186 credits
Members referred : 0


Working hard to build in PHP


« Reply #10 on: Jul 16, 2007, 12:09:39 pm »

Oh! My project Spam list is really hot.
It has some real nasty domains on it.
If I put a regular domain on the list and you search for their domain it comes up on page 2 of Google. If you add a word Spam they will be on page one --- in the top 10.

Anyway I am adding nasty people to the list.
I do not like being abused by assholes!

If you have some assholes you want to add to the list let me know!
We the hackers need to stick together....

So crackers = Spam
Wink

I hope you know the real meaning of a hacker, it does not mean to hack but to code.
Nikolas' Servant's Servant
*
Gender: Male
Posts: 29
186 credits
Members referred : 0


Working hard to build in PHP


« Reply #11 on: Jul 16, 2007, 12:11:06 pm »

Nik be careful not to duplicate your domain with the proxy duplicate content.
One page no problem but if you do many pages will lose PR.
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #12 on: Jul 16, 2007, 12:13:02 pm »

Proxies usually don't have any good results in SERPs as they have 99% duplicate content. But in any way I don't think that your site can be affected in SERPs because it is indexed in proxified pages.

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Nikolas' Servant's Servant
*
Gender: Male
Posts: 29
186 credits
Members referred : 0


Working hard to build in PHP


« Reply #13 on: Jul 16, 2007, 12:14:19 pm »

Anyway, I am almost done with my project v 1.0 and will be moving it to the authoritative domain.
Then I am going on vacation to China, Laos, Thailand, and Israel.
Nikolas' Servant's Servant
*
Gender: Male
Posts: 29
186 credits
Members referred : 0


Working hard to build in PHP


« Reply #14 on: Jul 16, 2007, 12:16:01 pm »

Nik, you are wrong proxies can kill a Website.
They attack dynamic urls and duplicate them.
So I give 404 to dynamic strings that I do not have.
Nikolas' Servant's Servant
*
Gender: Male
Posts: 29
186 credits
Members referred : 0


Working hard to build in PHP


« Reply #15 on: Jul 16, 2007, 12:17:14 pm »

Look up canonical duplication to undestand what it is about.
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« Reply #16 on: Jul 16, 2007, 12:18:12 pm »

one of my proxies got banned from google, because I blocked the access from the SERP's

Sad

Nikolas' Servant's Servant
*
Gender: Male
Posts: 29
186 credits
Members referred : 0


Working hard to build in PHP


« Reply #17 on: Jul 16, 2007, 12:22:23 pm »

Okay webdigity.com/index.php/ t=1 , 2, 3 etc. will show the same page.
If I am to set up a site map with virtual urls they will all get indexed and duplicate each other.

I will need to add the site map to a high PR page.
It will probably will not do any damage to your site because your site is authoritative but for a weaker site you can give a site Google penaly -950

Not nice-->
Nikolas' Servant's Servant
*
Gender: Male
Posts: 29
186 credits
Members referred : 0


Working hard to build in PHP


« Reply #18 on: Jul 16, 2007, 12:26:11 pm »

Somebody just tried to do it to my site.
They put my canonical domain mail on a high PR Website.
Ask.com picked it up and duplicated my whole site.
I was lucky I caught it in time before Google indexed the duplicate domain.
I did a 301 mail.example.com to example.com

Not only I saved my ass but I got the PR juice from duplication.
Nikolas' Servant's Servant
*
Gender: Male
Posts: 29
186 credits
Members referred : 0


Working hard to build in PHP


« Reply #19 on: Jul 16, 2007, 12:58:15 pm »

Hey, I just realized, I get paid for Spamming here...

I have to write a script to post for me-->
Trackback URI for this entry : http://www.webdigity.com/trackback.php?topic=6913
Tags : Proxy Scraping Bookmark this thread : Digg Del.icio.us Dzone more....

Pages: [1] 2 Print 
Webdigity Webmaster Forums  >  WebDigity Community  >  Forum Lounge
Topic: you are being scraped by a proxy
« previous next »
Jump to:
User Area
Welcome, Guest. Please login or register.
Did you miss your activation email?
May 28, 2012, 10:12:21 pm





Login with username, password and session length

Donate to our community, and get a permanent link back to your site!

Donate to our community, and get a permanent link back to your site!






Web Design Gallery · Whois Lookup · Pagerank · Tag Browsing · Lo-fi version · Syndication · Webmaster forum history · Advertise
Developed by HumanWorks © 2005 - 2012 Webdigity webmaster community · sublime directory
Webdigity Webmaster Forums | Powered by SMF 1.0.12. © 2001-2005, Lewis Media. All Rights Reserved.