re: the Future of the Internet

Updated: 2011-05-07T15:03:36Z


The First 5 Months of Kinect Hacking: Amazing


I hadn't been keeping up on the Kinect mods that are coming out, I've been too busy doing far less glamorous backend work lately. But I came across this montage put together by Johnny Lee that compiles some of the...

Relationship Strength


The skunkworks project that I've been working on for the past month or so incorporates the idea of relationships between entities to enable automatic discovery and data recommendations In said project there is a bit of code that watches the...

Data Recommendations


One of the ideas I've been playing with in my data analysis skunkworks project is the concept of "Data Recommendations". The gist of it is that you can pretty easily show people data that they'll probably find interesting if you...

Data Lenses


Recently I have been playing with a concept that I just made up called Data Lenses. The idea is that you can construct scenarios based on information you're interested in and see how it affects everything else in the system....

Meta Analytics


This is a continuation of my thoughts the other day on what makes data interesting. The gist of it was that the really interesting and impactful data is hard to get to, the easy stuff to get to is common...

This is a continuation of my thoughts the other day on what makes data interesting.  The gist of it was that the really interesting and impactful data is hard to get to, the easy stuff to get to is common knowledge and therefore not as valuable.  The stuff that everyone knows is common knowledge, a much bigger impact is going to be made by going after the other stuff.

If that is true then the most important and impactful task at hand is bringing up the percentage of stuff that you do know.  Going after the long tail inch-by-inch.

One of the primary advantages that Big Data provides in my opinion is the ability it gives you to not just store every bit of data you receive but to spend additional time analyzing each bit, researching it, and then storing useful meta-data about it.  This is the work that makes faster than real-time analytics possible.

Which brings me to my point, which is that analytics about analytics (meta analytics) is going to be increasingly important.  You'll need to know what percentage of bits you receive you're able to successfully mine meta-data about, and this will be the most important metric you see.

This is the number of customers you can identify, the number of calls you route successfully, the number of visitors you successfully profile, the number of assets you can confidently price.  The number of decisions you can accurately make in advance.

I'm thinking of a dashboard something like this:

It's not about what you might be able to know, it's about what you actually do know.  If the potential is there but the execution is not, what's the point?

I suspect this type of information will become inreasingly valuable and prominent in the near future as big data proliferates.

The Interesting Stuff


There are a ton of data sources out there that can easily be pulled in and learned from. Sources like Twitter, LinkedIn, Facebook, and even enterprise data sources like internal CRM, bug tracking systems, customer suppoert, and communication systems. It's...

Going Faster Than Realtime with Brute Force


Real-time is not a hard limit. But the only way to operate in faster than realtime is to deal in probabilities, using as much data as possible. The more data you have the more confidence you can have that something...

Opportunities from Big Data & Analytics


I've been thinking a lot lately about the fundamentals of analytics and how to break them down to their core components from a business-needs perspective. I have been dealing with this directly for years in the contact center market, and...

Analytics and Outliers


In any given set of data there is: The norm And there are outliers Most reporting and analytics tools are excellent at telling you the norm, but don't help you find outliers, or give you extremely crude tools for using...

What's the Best Blogging Platform?


When I first started blogging I signed up with TypePad because hey, it was 2006 and Wordpress was still pretty new. I went the fast and easy route. Needless to say, I outgrew their platform within a year or two,...