Archive for the ‘Updates’ Category

Historic Index Update: January 2013

By Dixon Jones | |

We have now updated our Historic Index. Here are the new stats: Historic Index Pages crawled: 391,428,634,355 Unique URLs: 4,060,890,688,027 Date range: 05 May 2007 to 05 Dec 2012 Last updated: 02 Jan 2013   You can keep an eye on our index sizes from the home page of the site. The… Continue reading


Historic Index Update

By Alex | |

We now have the Historic Index Update and it now contains link data all the way from 07 Apr 2007 to 07 Nov 2012. The vital statistics as of today are: Unique pages crawled: 390,085,384,871 Unique URLs: 4,032,653,283,610… Continue reading


4,006,013,830,026

By Dixon Jones | | 1 comment

We just updated the Historic Index. For the first time ever, we hit the four trillion mark. Historic Index Pages crawled: 388,843,317,776 Continue reading


Historic Index Update

We now have the Historic Index Update and it now contains link data all the way from 15 Feb 2007 to 16 Sep 2012. The vital statistics as of today are: Unique pages crawled: 385,898,973,684 Unique URLs: 3,960,346,968,255… Continue reading


Historic Index Update

We now have the Historic Index Update for this month so that it now contains link data all the way from 30 Dec 2006 to 31 Jul 2012. The vital statistics as of today are: Unique pages crawled: 381,918,900,955 Unique URLs: 3,918,860,182,616… Continue reading