BlogCadre users see no ads!  Popular topics: humor, video, links, cool, wtf.  Go create an account!




Digging Alexa - how the geek demographic doubled overnight

It seems to have passed without huge fanfare, but on April 20th 2006, the Alexa rankings for tech sites around the globe suddenly doubled, literally overnight.

The Day The World Got Geeky

Ian Clarke writes, "Did the world get geekier around April 20th?"

Some kind of change to how Alexa calculates traffic – or did something happen to so dramatically affect these four websites? Perhaps a bunch of geeks suddenly decided to become Alexa users.
Alex Walker noticed the phenomenon as early as the 27th, titling it "The Great Internet Spike of 2006."  Alex noticed that only tech sites seemed to benefit from the Alexa bump:

sites with no notable ‘tech-skew’ (i.e. CNN.com, EBAY.com, etc) have either held firm or been shuffled backwards by the sites bubbling up around them.

Have Alexa changed their statistical algorithms?
Is this a temporary anomoly?
Which sites lost out the worst?
Even Digg users have been speculating:

hayseed: also possible that a crapload of people installed the alexa toolbar at that time as a result of some sort of promotion ...

hottuna: Alexa is so incredible unreliably its strange that the site hasn't been shut down.

jarcoal: exactly. there have been several articles reporting major traffic boosts in the last few months. i'll bet this is all some stupid glitch.

When Elephants Fight

I've been looking at this a bit, and I'm convinced it's no Alexa glitch.  Rather, the Alexa population did, in fact, change overnight.

Here's the funny part: Digg users were the scalawags who did it!

Before I tell you why this happened, let's take a look at a graph:

April 2006 Alexa Spike

Here you see slashdot (red line) moving along toward mid April, trending slightly downwards.  Digg (blue line) appears to have a consistent trend as well, though their user base is steadily growing.  Then, around mid April a singularity occurs as both lines meet.  BANG!

This isn't a spike, folks.  It's a massive, towering wall of geekdom.  The same wall hit Wired, BoingBoing, Engadget, Gizmodo and just about every other tech-bent site on the planet.

Now, I know what you're thinking...  When those two lines merged, all the Digg users and the Slashdot users put aside their differences, started mingling, got friendly, and had litters and litters of geeky babies, thereby doubling the geek population in a single evening.  I was thinking this too, but then my wife reminded me about our own baby.  I can attest, from personal experience, that even for geeky humans the typical gestation period is about 38 weeks.

Now, I'm not totally ready to rule this theory out, but I figure we have 'till about late December or early January 07 before we see the SlashDigg baby spike on Alexa.  Even then, it's only going to be the real hackers that push their way out and immediately trade in their umbilical cord for an 802.11 hotspot.

Lost my train of thought -- back to what happened in April.

The truth all falls back on what Ian and hayseed had speculated: suddenly, one fine April day, a _lot_ of techy folks downloaded and installed the Alexa toolbar.  So many, in fact, that their statistical influence shuffled the rankings down of huge sites with no nerd bias.  The interesting thing is that it had nothing to do with an Alexa promotion, a gang of rogue Digg hackers, or any intentional funny-business.

In a way, though, it actually was because of the convergance of those two little lines.


The Masses Converge


In mid April, Digg approached the worldwide reach of Slashdot, formerly regarded as the most widely read tech site on the net.  People had been speculating about the event for some time.  Then, on April 19th, "it finally happened," writes ejoyner.  "Digg overtakes Slashdot" is posted and the story instantly hits the Digg front page.

Hundreds of thousands of Digg readers follow a link to Alexa en-mass to see internet history being made.  Some percentage of them install the Alexa toolbar that very day, and the head-count that this percentage represents is huge enough to significantly skew the Alexa demographic from that point forward.


Observations

This seems to be a pretty unique event, and I'm left with a couple of thoughts.

First, if you are the devious webmaster of a really large site, you can significantly skew the Alexa rankings in your site's favor simply by driving your users to Alexa with an interesting story.  Ironically, if Slashdot had announced the story that Digg had surpassed it in ranking, we would likely have seen the Slashdot ranking spike to the top.  By not heavily publicising their own bad news, they effectively allowed Digg to claim a substantially higher Alexa ranking!

What if no announcement had been made?  What if no Digg users downloaded the toolbar and Alexa was left to continue charting internet popularity with their former sample base?  Did Digg really overtake Slashdot in the end?

Ultimately, nobody but Alexa could really know for sure, but if we were to assume for a moment that the Digg and Slashdot graphs continued their pre-20th trends and approached eachother at the end of April, we may have seen something like this (adjustment translated below actual data):

April 2006 Alexa Spike (adjusted)

Just look at the correlation between those two graphs over the mid April to mid June period!  For as much as they complain about eachother, it would appear that Slashdot and Digg users represent the exact same population.

Also, in this hypothetical scenario, Digg really only began reaching more readers than Slashdot in late June.  A smart Slashdot editor could probably capitalize on this and declare right now that Digg has officially bested them, with a prominent link to Alexa to prove it.  Did I just say that out loud? ;)


Geek Rank Your Site

One final interesting take-home from this whole discussion is that you can use the April 20th "geek day" to gauge the geek factor of your favorite sites.  How much spike did you see on geek day?  Did you see a drop?  Make sure to tell us about it in the comments.

Trackback URL for this post:

http://www.blogcadre.com/trackback/1486
from UserDriven on July 7, 2006 - 1:30am

"In mid April, Digg approached the worldwide reach of Slashdot, formerly regarded as the most widely read tech site on the net. People had been speculating about the event for some time. Then, on April 19th, "it finally happened," writes

from kottke.org remaindered links on July 5, 2006 - 10:30am

http://www.blogcadre.com/blog/jason_striegel/digging_alexa_-_how_the_geek_demographic_doubled_overnight_2006_06_30_20_52_03...

from Simpy Chichimichi on July 3, 2006 - 10:22pm

Earlier today Scott Matthews, the author of Bitty, sent me a link that might contain the answer to my earlier question about the Alexa Spike Anomaly. As this post explains, or perhaps I should say speculates, the Alexa spike was caused by the April ...

Maybe it is because of A9?

It might be because of A9.com or their toolbar. They share information with Alexa since A9, as Alexa, is an Amazon company. So maybe alot of users installed the A9 toolbar? Or maybe alot of users started using the A9.com search page?

Probably right but...

the only thing this really shows is how small the actual number of Alexa Users is ... and that again shows how useless Alexa is

Incorrect

The Digg story was posted on March 19th, not April 19th. Check the dates on the comments. I was unable to find any similar stories/dupes posted on Digg on or around April 19th, either, so it doesn't look like this theory holds water.

oh my god

Jason Striegel's picture

You are absolutely correct - I'm an idiot, and thank you for catching this.

In my embarrassment, I'm heading back to the drawing board to try and figure out the cause of this spike.

It's all about the spyware.

Something you've got happening is a negative number of slashdot readers - something that is impossible. You're assuming a continuous amount of users kept the Alexa or A9 toolbar installed. I'd actually think that slowly the numbers would reduce as more and more people ran spyware checkers that delete Alexa components, or otherwise removed the Alexa software once they realised what was going on.

This seems to happen more with slashdot readers than digg readers. Does this mean that slashdot readers are smarter than digg ones? Arguably, digg has a much younger demographic who are more likely to run Windows, and are more likely to fall in the "wannabe geek" category.

This is why Alexa is useless and anyone basing their web traffic stats (particularly geek-oriented ones) are hitting the lowest common denominator - a group who don't know what spyware is or how to get rid of it.

The position of the moon

In the original Zoroastrian calendar 4/20 was the day of convergence and the number 420 was the mark of the Beast Master. This corresponds strangely to the modern Earth Day, Columbine and the celebration of the California penal code 420. It was probably a mix of occult magic and bored hippies eating weed brownies.

maybe not

I don\\\'t think your theory is accurate:
- The Digg story \\\'Digg vs. Slashdot\\\' that you linked to was posted on March 19th, not April 19th.
- Your graph shows the \\\'Daily Reach\\\' graph, which does indeed have its first crossover on April 19th. However, the Digg story is actually linked to the \\\'Daily Traffic Rank\\\' graph, on which the first crossover occurred a month earlier:

http://www.alexa.com/data/details/traffic_details?&range=6m&size=large&compare_sites=slashdot.org&y=t&url=digg.com

- It doesn\\\'t appear a different Digg story was the culprit, either: a quick search on Digg will reveal that there were no stories regarding Digg vs. Slashdot (dupes of this one or otherwise) posted on or around April 19th.

Sorry to burst the bubble - it sounded like a good theory, but it doesn\\\'t appear to hold up against the evidence.

3/19 != 4/19

Jason Striegel's picture

you are absolutely correct. thanks for the catch.

I had been sure it was google summer of code

When Google announced their SoC program, sites like drupal.org started getting huge amounts of traffic from Google, and this all happened around the same day (don't know exact date for sure). Furthermore, Drupal had just released 4.7, so I was sure that the spike had come from those factors. This new theory does make a lot of sense, though.

blogcadre.com

Somehow I feel that blogcadre.com:s Alexa ranking is also about to raise a bit ;) Mover and shaker next week?

I had a spike around

I had a spike around mid-april for my personal blog, I usually recieve 10 - 15 reach per million users. Butt in mid april I got 40 Million. Just take a look.

Alexa Graph

Very interesting article!

funny ...

my blog hit an overall low just on the 20th of april, but spiked up to an overall high just on 21st ... and by overall high, i mean that i had about 2 times the hits i have on average days.

the whole spike lasted for exactly 2 1/2 days then it normalized.
have a look at the graph here:
http://img128.imageshack.us/img128/8166/spike4bi.png
(sorry for .png .. no image converter + no admin rights here ...)

at least now i know what it was.

Interesting, but the dates don't match

Jason, interesting observations. However, the date of the Digg story and the date of the Alexa spike don't match, as I explained here. What do you think?

how did i manage to bungle that?

Jason Striegel's picture

thanks otis. have you seen any credibility lying around? i seem to have misplaced mine :)

j

Damn.

Sounded brilliantly plausible, Jason. Back to the old drawing board.

Has to be new data

I have to say I like the idea of them adding a new data source, although I wouldn't have thought that the A9 toolbar would have attracted a super techy demographic.