Majestic is pretty good at handling domain names. We are able to accurately, and at speed, calculate referring domains, then present this data with one of the lowest latencies across any of the “Big 3” backlink indexes (Majestic, Moz, and Ahrefs).

As good as it is, we aren’t perfect, and a handful of TLD’s are handled in a way that is inconsistent with the expectation that we adhere to the modern-day “bible” of public suffix/TLD handling, the Mozilla public suffix list

This problem is split into two parts:

  1. Showing existing links to omitted domains, due to the public suffix miss-match
  2. Counting links from domains hidden behind omitted domains, due to the public suffix miss-match

When we’re asked why we haven’t updated our parsing to include parsing for the Mozilla list, our answer is; we have tried, but found that our Historic Index is too huge!!!

To fully address this, we face either significant costs (to build a new, parallel, Historic Index), or a significant delay in Historic Index turn-around time.  These solutions are very painful, in their own ways.

We do have a roadmap to resolve this issue, but it’s still some way off, so we wanted to find a quick way to address at least some of the problem.

Alex came up with a great idea to lever the redirect logic (see https://blog.majestic.com/development/301-redirect/ ) to solve the first of our two issues, where we try to better show existing links to troubled domains.

We have just pushed this update live, and you will be able to see the effect of this in the before and after pictures, below…

Before:

After:

 

Save

Save


Steve Pitchford

Steve has worked with Majestic since 2009, managing the development team for a number of years before moving onto the Board. Steve worked for UK e-retailer Jungle.com through much of the first dotcom boom after developing a passion for the web during his BSc in Computer Science.

Steve played a critical role in developing the companies outreach programs with local universities and remains committed to helping the next generation find meaningful careers in tech.

Steve has been engaged with the Birmingham tech scene for years, co-organising the grassroots open-source conference YAPC:: Europe 2008, and founded the West Midlands Java User Group in 2014.

THANK YOU!
If you have any questions in the meantime, please contact help@majestic.com
You have successfully registered for a Majestic Demo. A Customer Advisor will contact you shortly to schedule a suitable time to connect.