24, July 2008

getting Alexa information for free - webmaster forum

 
Webdigity webmaster forums
This forum shares its ad revenue with its members!
[ Home | Help | Search | Forum's Shop | Archive | Login | Register | Webmaster Directory ]
Webdigity Webmaster Forums  >  Web Development  >  PhP
Topic: getting Alexa information for free
« previous next »
Pages: [1] Print

Author Topic: getting Alexa information for free  (Read 1664 times)
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6280
38506 credits
Members referred : 374


It's time to use PHP5!


« on: Jun 27, 2006, 08:32:15 AM »

Hello,

I need to retrieve some data from the alexa page on my own website, its about this data (for example):
http://www.alexa.com/site/site_stats/signup?site_url=www.webdigity.com&widget=s&style=a&submitted=true&mode=stats&amzn_id= Visit through proxy

In know its possible to use their webservices but they are not free (your have to oay if you reach a  number of requests).

do you know a fast way to retrieve them a different, legal way? (using php)


Last blog : 4th of July Lottery from TemplateMonster.com
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 7975
40807 credits
Members referred : 3



« Reply #1 on: Jun 27, 2006, 11:37:21 AM »

First, I don't think it is legal, but I guess if you want to do this anyway, you should grab the content of this page :

http://www.alexa.com/data/details/main?q=&url=webdigity.com Visit through proxy

Check the code of that page, I think it is easy to grab the ranking from there.

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : MIA - Where Nick and Tim
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6280
38506 credits
Members referred : 374


It's time to use PHP5!


« Reply #2 on: Jun 27, 2006, 12:06:45 PM »


Quote
First, I don't think it is legal, but I guess if you want to do this anyway, you should grab the content of this page :
You're right this is my next problem, but I'm affraid the the free impressions are nit enough...


Quote
Check the code of that page, I think it is easy to grab the ranking from there.
I thought about that, but it takes to much loading time. (keep in mind that the alexa site is not so fast)


Last blog : 4th of July Lottery from TemplateMonster.com
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 7975
40807 credits
Members referred : 3



« Reply #3 on: Jun 27, 2006, 12:16:39 PM »

You can't deal with the loading time. Of course if you will use CURL it will be much faster, but you can't do something for crawling faster the site

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : MIA - Where Nick and Tim
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6280
38506 credits
Members referred : 374


It's time to use PHP5!


« Reply #4 on: Jun 27, 2006, 12:25:34 PM »

You can't deal with the loading time. Of course if you will use CURL it will be much faster, but you can't do something for crawling faster the site
the fastest way is using their web services, but 10.000 free requests are not so much...
100.000 addtional requests are 15USD


Last blog : 4th of July Lottery from TemplateMonster.com
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 7975
40807 credits
Members referred : 3



« Reply #5 on: Jun 27, 2006, 01:39:39 PM »

Then I guess there is no other solution than using their site.

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : MIA - Where Nick and Tim
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6280
38506 credits
Members referred : 374


It's time to use PHP5!


« Reply #6 on: Jun 27, 2006, 01:41:39 PM »

Then I guess there is no other solution than using their site.
it looks like, maybe I have to cache the requests inside a database...


Last blog : 4th of July Lottery from TemplateMonster.com
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 7975
40807 credits
Members referred : 3



« Reply #7 on: Jun 27, 2006, 01:47:20 PM »

Quote
maybe I have to cache the requests inside a database...

That's a must, but have in mind that this can produce overhead as you will have many records with varchar keys

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : MIA - Where Nick and Tim
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6280
38506 credits
Members referred : 374


It's time to use PHP5!


« Reply #8 on: Jun 27, 2006, 01:48:59 PM »

Quote
maybe I have to cache the requests inside a database...

That's a must, but have in mind that this can produce overhead as you will have many records with varchar keys

is there an other way? I think I have to index the the web addresses to make it quick


Last blog : 4th of July Lottery from TemplateMonster.com
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 7975
40807 credits
Members referred : 3



« Reply #9 on: Jun 27, 2006, 01:53:29 PM »

You can create a table like this :

domain
tld
rank

Example row :

webdigity
com
44.000

Of course the two first rows will be primary key, so the indexing will be much faster, and it will be able to handle many thousands records with a light server.

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : MIA - Where Nick and Tim
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6280
38506 credits
Members referred : 374


It's time to use PHP5!


« Reply #10 on: Jun 27, 2006, 01:57:45 PM »

You can create a table like this :

domain
tld
rank

Example row :

webdigity
com
44.000

Of course the two first rows will be primary key, so the indexing will be much faster, and it will be able to handle many thousands records with a light server.
yes this is what i thought, but how about a table with more then 100.000 records?


Last blog : 4th of July Lottery from TemplateMonster.com
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 7975
40807 credits
Members referred : 3



« Reply #11 on: Jun 27, 2006, 02:03:48 PM »

Big tables will work much better with mysql 5, but anyway don't be afraid, as mysql is very well optimized.

BTW what are you going to with this?

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : MIA - Where Nick and Tim
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6280
38506 credits
Members referred : 374


It's time to use PHP5!


« Reply #12 on: Jun 27, 2006, 02:05:57 PM »

Big tables will work much better with mysql 5, but anyway don't be afraid, as mysql is very well optimized.

BTW what are you going to with this?
I created this Google module to promote my thumbnail service (soon):
http://fusion.google.com/add?moduleurl=http%3A//www.finalwebsites.com/webpage_information.xml Visit through proxy


Last blog : 4th of July Lottery from TemplateMonster.com
I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 7975
40807 credits
Members referred : 3



« Reply #13 on: Jun 27, 2006, 02:08:42 PM »

BTW I just added the module, and I see that it does not accepts urls without http://

Maybe you should make it work without it too.

Trial and Error my two best teachers Cool
Join us @ facebook Visit through proxy

Last blog : MIA - Where Nick and Tim
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6280
38506 credits
Members referred : 374


It's time to use PHP5!


« Reply #14 on: Jun 27, 2006, 02:10:24 PM »

BTW I just added the module, and I see that it does not accepts urls without http://

Maybe you should make it work without it too.
yes it's a first version, but you are getting an error message Wink


Last blog : 4th of July Lottery from TemplateMonster.com
Trackback URI for this entry : http://www.webdigity.com/trackback.php?topic=3044
Tags : google mysql curl databases web services Bookmark this thread : Digg Del.icio.us Dzone more....

Topic sponsors:
Get a permanent link here for $1.99!


Pages: [1] Print 
Webdigity Webmaster Forums  >  Web Development  >  PhP
Topic: getting Alexa information for free
« previous next »
Jump to:
User Area
Welcome, Guest. Please login or register.
Did you miss your activation email?
Jul 24, 2008, 11:26:47 PM





Login with username, password and session length

Donate to our community, and get a permanent link back to your site!

Donate to our community, and get a permanent link back to your site!


Forum Statistics
Total Posts: 35.717
Total Topics: 7.379
Total Members: 3.710
Tutorials : 56
Resources : 143
Designs : 220
Latest Member: prolist

48 Guests, 3 Users online :

11 users online today:



Readers

Web Design Gallery · Whois Lookup · Pagerank · Tag Browsing · Lo-fi version · Syndication · Webmaster forum history · Advertise
Developed by HumanWorks © 2005 - 2008 Webdigity webmaster community · sublime directory
Webdigity Webmaster Forums | Powered by SMF 1.0.12. © 2001-2005, Lewis Media. All Rights Reserved.