28, May 2012

getting Alexa information for free - webmaster forum

 
Webdigity webmaster forums
[ Home | Help | Search | Forum's Shop | Archive | Login | Register | Webmaster Directory ]
Webdigity Webmaster Forums  >  Web Development  >  PhP
Topic: getting Alexa information for free
« previous next »
Pages: [1] Print
Instabuck - The easy way to sell digital products online

Author Topic: getting Alexa information for free  (Read 3619 times)
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« on: Jun 27, 2006, 07:32:15 am »

Hello,

I need to retrieve some data from the alexa page on my own website, its about this data (for example):
http://www.alexa.com/site/site_stats/signup?site_url=www.webdigity.com&widget=s&style=a&submitted=true&mode=stats&amzn_id=

In know its possible to use their webservices but they are not free (your have to oay if you reach a  number of requests).

do you know a fast way to retrieve them a different, legal way? (using php)

I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #1 on: Jun 27, 2006, 10:37:21 am »

First, I don't think it is legal, but I guess if you want to do this anyway, you should grab the content of this page :

http://www.alexa.com/data/details/main?q=&url=webdigity.com

Check the code of that page, I think it is easy to grab the ranking from there.

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« Reply #2 on: Jun 27, 2006, 11:06:45 am »


Quote
First, I don't think it is legal, but I guess if you want to do this anyway, you should grab the content of this page :
You're right this is my next problem, but I'm affraid the the free impressions are nit enough...


Quote
Check the code of that page, I think it is easy to grab the ranking from there.
I thought about that, but it takes to much loading time. (keep in mind that the alexa site is not so fast)

I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #3 on: Jun 27, 2006, 11:16:39 am »

You can't deal with the loading time. Of course if you will use CURL it will be much faster, but you can't do something for crawling faster the site

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« Reply #4 on: Jun 27, 2006, 11:25:34 am »

You can't deal with the loading time. Of course if you will use CURL it will be much faster, but you can't do something for crawling faster the site
the fastest way is using their web services, but 10.000 free requests are not so much...
100.000 addtional requests are 15USD

I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #5 on: Jun 27, 2006, 12:39:39 pm »

Then I guess there is no other solution than using their site.

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« Reply #6 on: Jun 27, 2006, 12:41:39 pm »

Then I guess there is no other solution than using their site.
it looks like, maybe I have to cache the requests inside a database...

I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #7 on: Jun 27, 2006, 12:47:20 pm »

Quote
maybe I have to cache the requests inside a database...

That's a must, but have in mind that this can produce overhead as you will have many records with varchar keys

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« Reply #8 on: Jun 27, 2006, 12:48:59 pm »

Quote
maybe I have to cache the requests inside a database...

That's a must, but have in mind that this can produce overhead as you will have many records with varchar keys

is there an other way? I think I have to index the the web addresses to make it quick

I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #9 on: Jun 27, 2006, 12:53:29 pm »

You can create a table like this :

domain
tld
rank

Example row :

webdigity
com
44.000

Of course the two first rows will be primary key, so the indexing will be much faster, and it will be able to handle many thousands records with a light server.

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« Reply #10 on: Jun 27, 2006, 12:57:45 pm »

You can create a table like this :

domain
tld
rank

Example row :

webdigity
com
44.000

Of course the two first rows will be primary key, so the indexing will be much faster, and it will be able to handle many thousands records with a light server.
yes this is what i thought, but how about a table with more then 100.000 records?

I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #11 on: Jun 27, 2006, 01:03:48 pm »

Big tables will work much better with mysql 5, but anyway don't be afraid, as mysql is very well optimized.

BTW what are you going to with this?

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« Reply #12 on: Jun 27, 2006, 01:05:57 pm »

Big tables will work much better with mysql 5, but anyway don't be afraid, as mysql is very well optimized.

BTW what are you going to with this?
I created this Google module to promote my thumbnail service (soon):
http://fusion.google.com/add?moduleurl=http%3A//www.finalwebsites.com/webpage_information.xml

I am a metal monkey!
Administrator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 5799
46391 credits
Members referred : 3



« Reply #13 on: Jun 27, 2006, 01:08:42 pm »

BTW I just added the module, and I see that it does not accepts urls without http://

Maybe you should make it work without it too.

Trial and Error my two best teachers Cool
Join us @ facebook or twitter

Last blog : Butterfly Marketing 2.0
Global Moderator
Community Supporter ?
Jedai Sword Master
*****
Gender: Male
Posts: 6691
34714 credits
Members referred : 374


It's time to use PHP5!


« Reply #14 on: Jun 27, 2006, 01:10:24 pm »

BTW I just added the module, and I see that it does not accepts urls without http://

Maybe you should make it work without it too.
yes it's a first version, but you are getting an error message Wink

Trackback URI for this entry : http://www.webdigity.com/trackback.php?topic=3044
Tags : google mysql curl databases web services Bookmark this thread : Digg Del.icio.us Dzone more....

Pages: [1] Print 
Webdigity Webmaster Forums  >  Web Development  >  PhP
Topic: getting Alexa information for free
« previous next »
Jump to:
User Area
Welcome, Guest. Please login or register.
Did you miss your activation email?
May 28, 2012, 01:38:40 pm





Login with username, password and session length

Donate to our community, and get a permanent link back to your site!

Donate to our community, and get a permanent link back to your site!






Web Design Gallery · Whois Lookup · Pagerank · Tag Browsing · Lo-fi version · Syndication · Webmaster forum history · Advertise
Developed by HumanWorks © 2005 - 2012 Webdigity webmaster community · sublime directory
Webdigity Webmaster Forums | Powered by SMF 1.0.12. © 2001-2005, Lewis Media. All Rights Reserved.