We think we have won the “mine is bigger than yours” debate. Now we want to not just crawl faster, but also smarter.

We think we have won the “mine is bigger than yours” debate. Now we want to not just crawl faster, but also smarter.
we are working on a new version of the fresh crawl data to be launched in January 2011.
We have updated our main backlinks index that now contains nearly 2.9 trillion unique URLs.
Sneaking it on on a Friday is unusual for us – but we’ve been itching
Inspired by Aaron Wall’s Hubfinder tool, we felt that with Yahoo’s API looking a little