Today we are releasing under creative commons, a list of the top 100,000 websites broken down by the country in which they are hosted. Francois – our French ambassador – was working on some research for another post and asked if we could gethim a list of the top 1,000 websites hosted in France from our Majestic Million list. The main list – which updates every day – lets you sort by TLD, but does not have a full location lookup. So – there was no EASY way to get this. Of course, we never do EASY stuff at Majestic, so Chris – our Network Administrator started at number 1 in our Majestic Million list and set up a routine to look up the hosted location of the site before moving onto item 2… The plan was to carry on until we had 1,000 French hosted sites in the list.

Then Chris left his PC running and went home…

The next morning the program was still running. We had well over 3,000 French hosted websites in the list… and 150,000+ in all. So we decided to give the first 100,000 or so away for you to play with.

The data in the CSV file

GlobalRank  – This is the global rank of the website in our Majestic Million – starting at the biggest (Google.com) at position #1

TldRank    – This is the rank of the site in relation to all sites in the list with the same Top Level Domain suffix (.com /.net /.fr etc.)

Domain  – The domain itself

TLD    – We left the Top Level Domain suffix itself as a column for easy sorting

RefSubNets    – The Referring “C subnets” – explained in our glossary of terms. This is how we sort the Majestic Million list.

RefIPs    – The number of unique IP numbers linking to the domain

IDN_Domain    – Usually the same as the “Domain” column, but there are some occassions when this differs because these websites are not in a character set that most of us recocnile. For example: http://つけまつげ.net/ does not translate well into a CSV file which is ACII only!

IPAddress  – The IP number we found the domain on

GeoCountry – The really new bit… where the domain is hosted according to our best guess.

It is not perfect, because many sites use what is called a “CDN” which helps distribute large sites over several servers – potentially hosted in several countries. It is pure chance in this case as to which one we saw – or we saw the one that a search from the UK would have seen. However – most CDNs are all in the same country, so this error will be pretty small. Also – in some cases – we were not able to resolve the IP number for whatever reason. In these instances we have also not reported a country code as with a few other instances. I therefore actually put 103,000 in the list so there are a few more for you just in case.

The data is free. It’s in a CSV download…

To Download the Top Websites by Country

EDITOR UPDATE: THIS LIST IS NOW UPGRADED TO THE MAJESTIC MILLION LIST. IT IS A CSV FILE WITH A MILLION LINES AND WILL REQUIRE A MODERN VERSION OF EXCEL TO READ (OR SOME OTHER WAY TO READ CSV FILES)
Enjoy!

Comments

  • EL

    I figured google is the number 1 site in the world. It just has a strong search engine presence that nobody can match.

    March 14, 2013 at 1:01 pm
    • Dixon Jones

      Yes – the top ones are all pretty predictable and tend to be similar in Alexa as well. However – the correlations with Alexas list of top domains differs quite substantially further down, I notice. For example, MajesticSEO.com is around 30,000 in our list… which is impressive enough… but we are at 1,040 in Alexa as of today (which is astounding, frankly). That’s a pretty big difference. Of course, the lists measure different things. We rank by link equity (actually, by the number of referring subnets I think) and Alexa is supposedly measuring traffic – although I do not know really how they collect their data.

      March 15, 2013 at 1:28 pm
  • Peter Mead

    This is awesome work! Thanks for all the hard work that went into this list. The whole GeoCountry thing is something that not everyone is doing well.

    Will be a nice chunk of data in my toolkit ;)

    March 15, 2013 at 1:17 pm
    • Dixon Jones

      Glad you like it. Sometimes things just fall into place. This was one of those times – so happy to share.

      March 15, 2013 at 1:24 pm
  • Vic Shoup

    This is great! Thanks for making this available. Was there a similar list published in the past to compare against?

    March 15, 2013 at 1:46 pm
  • Sebastian

    Excellent resource, thanks a lot. There will be some places like China and Russia where their own search engines will take the number one spot. But, it will be interesting to see how is Facebook doing globally.

    March 22, 2013 at 8:45 pm

Comments are closed.