October’s Linkscape Update




As many of you likely noticed, Linkscape updated its index on Thursday night. New data is now available in the SEOmoz Firefox and Google Chrome toolbars, Open Site Explorer, the classic Linkscape tool and many of our other SEO tools.

This update was, sadly, just over 2 weeks off schedule, primarily due to some hardware failures at Amazon’s EC2 where we run processing on our large link graph to produce the metrics and views for the API. Although we’ve encountered issues like this in the past, this was one of the larger failures and meant processing had to be restarted several times to update the index. You might be able to read more about the technical details in the near future on our nascent and geektacular Dev Blog.

Index Stats

* Pages: 41,219,038,886 (41 Billion)
* Subdomains: 436,693,488 (436 Million)
* Root Domains: 99,649,652 (99 Million)
* Links: 402,521,240,277 (402 Billion)

I made some graphs showing a few interesting trends over the past few months in the web’s adoption/use of certain protocols.

oct-linkscape-nofollows - webmasterfree.net

The chart above shows how using rel=nofollow on internal links is slowly becoming less popular (though it’s still a majority of use).

oct-linkscape-relcanonical - webmasterfree.net

This chart’s telling us that rel canonical use has barely grown from June to October (as a percent). In this index, 5.42% of the pages we saw used rel=canonical tags. The datapoint from May (when rel=canonical was on 5.50% of pages we saw) is curious, but I suspect it has more to do with which pages we were choosing to crawl and index vs. an actual shift in usage. It’s a good reminder, though, that unless we see large, sustained shifts across indices comprised of relatively similar URLs, we shouldn’t jump to conclusions.

The next scheduled update for Linkscape is Nov. 12th (see the Linkscape Calendar page on our API Wiki) and we hope to be in much better shape with hitting that deadline.

Linkscape is also undergoing some serious upgrades over the next 3 months. With our web app launched (and regular upgrades on track), 4 of our 10 engineering folks (Phil, Chas, Bryce & Ben) are going to be working to make Linkscape fresher, faster, more comprehensive and higher quality by January. Expect to see some incremental improvements between now and then, which we’ll report here on the blog.

Source : http://www.seomoz.org/blog/october-linkscape-update
October 16th, 2010 – Posted by randfish to SEOmoz News

Tags:

Comments (55)

 

  1. Thanksimpressive blog long time looking for. my guide for my web Posicionamiento Web

  2. dog grooming says:

    I like reading this site but I can’t get it to load on my phone when I am at work, any ideas on how to fix that?

  3. Emmitt Okeke says:

    Hi Great site cheers for showing us.

  4. Just passing by to praise you for the wonderful read. It was really worth my time reading this post. Hoping for more wonderful posts soon! I added your feed in my reader!

  5. dog grooming says:

    Sick! Just got a brand new Iphone and I can now read your weblog on my phone’s browser, it didn’t work very well on my old Tmobile Wing.

  6. Strange this post is totaly unrelated to what I was searching google for, but it was listed on the first page. I guess your doing something right if Google likes you enough to put you on the first page of a non related search.

  7. I can’t believe your blog isn’t more popular. The information you give here would be useful to many people if you were only ranked better in Google. I found your site through a friend of mine or even I wouldn’t have came.

  8. I just found your website on Google and I must say, I’m impressed. I frequent a lot of blogs and yours is by far one of the best I’ve come across. The information you have here is concise and accurate and you have a very good writing style. Perhaps you should consider writing a book?

  9. Sick and tired of getting low amounts of useless traffic for your website? Well i want to share with you a fresh underground tactic that produces myself $900 per day on 100% AUTOPILOT. I could truthfully be here all day and going into detail but why dont you merely check their website out? There is really a great video that explains everything. So if your seriously interested in making hassle-free hard cash this is the site for you. http://www.autotraffic-avalanche.org

  10. Sick and tired of obtaining low amounts of useless visitors for your website? Well i wish to tell you about a fresh underground tactic that makes myself $900 on a daily basis on 100% AUTOPILOT. I possibly could be here all day and going into detail but why dont you merely check their website out? There is a excellent video that explains everything. So if your seriously interested in making easy money this is the website for you. http://www.autotraffic-avalanche.org

  11. I often read your blog admin try to discover it quite interesting. Thought it was about time i show you , Sustain the truly fantastic work

  12. You guys should spend alot of time working on this blog. im impressed

  13. Excellent blog post, I look forward to reading more.

  14. This is a good post, which features worthwhile information. If you invest your time in reading this, article it really worth it. This clause starts in a perfect way. The source has entire hold on the topic through away the article. I similar the manner in which author has ended his article. It is not a regular useless position in which eventide author is not surely that what just he wants to say.

  15. i think you have a nice page here… today was my initial time coming here.. i just happened to find it doing a google search. anyway, fantastic post.. i’ll be bookmarking this page for certain.

  16. Shizuko Too says:

    thanks, and keep up the good work

  17. Gold! you save my day ;)

  18. My spouse and I definitely think that this short article was highly beautiful. You’re definitely going to appreciate this quote. – “If you put tomfoolery into a computer, nothing comes out of it but tomfoolery. But this tomfoolery, having passed through a very expensive machine, is somehow ennobled and no-one dares criticize it.” ~ Pierre Gallois

  19. State Specific Jobs…

    [...]we like to honor other sites on the web, even if they aren’t related to us, by linking to them. Below are some sites worth checking out[...]…

  20. Great blog you have here but I was curious about if you knew of any forums that cover the same topics discussed here? I’d really love to be a part of online community where I can get feedback from other experienced individuals that share the same interest. If you have any suggestions, please let me know. Bless you!

  21. The blog was absolutely fantastic! Lots of great information and inspiration, both of which we all need!b Keep ‘em coming… you all do such a great job at such Concepts… can’t tell you how much I, for one appreciate all you do!

  22. In my opinion it already was discussed

  23. All Power America APG3202 Diesel Generator…

    [...]here are some links to sites that we link to because we think they are worth visiting[...]…

  24. blog says:

    Just killing some kittens in between classes on Digg and I found your post. Not normally what I desire to examine, nevertheless it was absolutely justified. Kudos

  25. free grant money for bills…

    [...]just below, are some totally unrelated sites to ours, however, they are definitely worth checking out[...]…

  26. mens watches…

    [...]below you’ll find the links to some sites that are well worth checking out[...]…

  27. Its like you read my mind! You appear to know a lot about this, like you wrote the book in it or something. I think that you could do with a few pics to drive the message home a bit, but other than that, this is excellent blog. A fantastic read. I will definitely be back.

  28. How to Car Repair…

    [...]the time to read or visit the content or sites we have linked to below the[...]…

  29. Cruises Leaving Charleston…

    [...]here are some other sites that we also recommend[...]…

  30. Ancona Chicken…

    [...]we like to honor other sites on the web, even if they aren’t related to us, by linking to them. Below are some sites worth checking out[...]…

  31. 1 Day Car Insurance…

    [...]one of our users suggests checking out the following website[...]…

  32. Buy Electric Guitar Packages…

    [...]below you’ll find the link to some sites that we think you should visit[...]…

  33. Cheers, enjoyed the read…

    [...]I link out rarely, but this was praiseworthy. Bravo, hope we can work together in the future[...]…

  34. Flax Seeds Benefit…

    [...] just below, are some totally unrelated sites to ours, however, they are definitely worth checking out. Posted in [...]…

  35. [...]while the sites we link to below are completely unrelated to ours, we think they are worth a read, so have a look[...]…

    [...]just below, are some totally unrelated sites to ours, however, they are definitely worth checking out[...]…

  36. Save Money with LED Light Bulbs…

    [...]while the web sites we website link to below are fully unrelated to ours, we believe they are worth a read, so possess a look[...]…

  37. aquacel…

    [...]the bellow sites are not closely releted to out site but I found this to be informative[...]…

  38. dating says:

    t0day I’m gonna post a 7 minute long video with a really beautiful babe, she’s so perfect! Slim toned body, fresh perky tits, recently shaved and sweet pussy. Take that along with the naughty personality and beggings like “I want your cock in my mouth” or “I want to feel your smooth sack” and we have the perfect girlfriend. She’s one fine babe, just look at those sexy lips and cute face… :)

  39. Ganar Dinero says:

    Unquestionably believe that which you stated. Your favorite justification seemed to be on the internet the simplest thing to be aware of. I say to you, I certainly get annoyed while people think about worries that they plainly don’t know about. You managed to hit the nail upon the top as well as defined out the whole thing without having side effect , people can take a signal. Will probably be back to get more. Thanks

  40. Medical Information Database…

    [...]although the sites we link to are completely unrelated to ours, we think that they are worth a read, so have a look[...]…

  41. [...]below you’ll find the link to some sites that we think you should visit[...]…

    [...]here are some links to sites that we link to because we think they are worth visiting[...]…

  42. 1.) Home Security…

    2.) [...]here are some links to sites that we link to because we think they are worth visiting[...]…

  43. I do not even know how I ended up here, but I thought this post was great. I do not know who you are but certainly you’re going to a famous blogger if you are not already ;) Cheers!

  44. 1.) Locksmithing…

    2.) [...]when we find a site that we think is cool we like to link to it and here is one of those sites. Check it out[......]…

  45. Charlie Sheen Videos…

    [...]we like to honor other sites on the web, even if they aren’t related to us, by linking to them. Below are some sites worth checking out[...]…

  46. Bloggers We Read…

    [...]the time to read or visit the content or sites we have linked to below the[...]…

  47. 1.) Keys, locks and more…

    2.) [...]we came across a cool site that you might enjoy. Take a look if you want[...]…

  48. Credit Debt says:

    Debt Free…

    [...]just below, are some totally unrelated sites to ours, however, they are definitely worth checking out[...]…

  49. ??????? ??????…

    [...]below you’ll find the link to some sites that we think you should visit[...]…

  50. The Diet Ultimatum…

    [...]just below you’ll see the link to several websites that we believe you might see[...]…

  51. Youre not the average blog writer, man. You definitely have something powerful to add to the web. Your design is so strong that you could almost get away with being a bad writer, but you’re even awesome at expressing what you have to say. Keep up the good work man!

  52. I was chatting with my friend on MSN about this and I’ve got to say that I completely agree with the poster near the beginning. And on a side note, I really like the colors you used for your blog. What theme is this?

  53. I have seen a lot of blogs but i really like the layout of yours. Keep up the good work my friend. :)

  54. Random question: I know you are using WordPress for this blog, but have you tried any other platforms? I am trying to decide whether to use WordPress or BlogEngine and I ask because I like yours.

  55. shopping voucher codes…

    [...]as an author, I rarely take the liberty to read outside where I specialize… But wow[...]…

Leave a Reply