The big data Strata conference in February of 2011 was a three day event covering everything a data scientist needs to go from zero to data hero. I’m reviewing the Strata videos as part of the O’Reilly blogger review program. The full video series covers those three days composed of 78 sessions, with so much information it’s taken me about half a year to write up a review. If you could clear your calendar you could easily spend a solid week just watching the content (which I didn’t have the ability nor desire to do, hence the long wait). It’s enough information overload when you’re just attending a three day event and only going to one session at a time. My mind often goes numb after the first two hours with all the information, and by the end of a two day conference I want to jump out the nearest window. The Strata video collection is a much more enjoyable way to take in the content.

Watching the Videos

There is an very large amount of information in the video collection. What I did was to identify the sessions which I felt would be most interesting for me. This entailed starting from the end middle, with topics like, Mining the Tar Sands of Big Data, and then I worked my way back to the start with the Data Bootcamp sessions. This gave me a more practical overview of the value of big data now and for the future, giving me motivation to learn the basics of data collection and interpretation in the bootcamp sessions. I like the Executive Summit sessions because it gives me a feeling for how the top managers might perceive the value of big data, which would naturally be different than my perspective. I’m still going over all the information in the videos, but I now know what big data means for the present and the future. The bootcamp sessions get you up and running with open source data tools based around Python and R. You can download these while watching the videos and follow along with their presentations.

Why Big Data Matters

How was Osama bin Laden found? Big data analysis helped pinpoint his location (according to Frontline). Big data analysis will replace individual intelligence gathering as a tool to pinpoint terrorist activity, troop movements, flood danger, probably even tsunami disasters, famines etc. Big data analysis holds huge potential for both good and evil, and is how we will predict the future trends with increasing accuracy, and the Strata videos will help you get your head around how to do it.

Why is Strata relevant? Big data is the commodity of the now, and of the foreseeable predictable future. Big data means being able to collect, digest, and interpret large data sets to find something useful. Useful could imply building a data consulting startup, data mining social networks, understanding from an executive position how big data can be used to improve your existing company. It will be an essential component in many businesses as we venture further into a future defined by data collection. Data market places will no doubt evolve where people can buy or license the use of big data sets, and probably big data use wars will ensue instead of patent disputes to dominate the intellectual property legal landscape of tomorrow. Strata covers all of the background topics necessary to make sense of the data future. There are talks on the ethics and privacy with big data, how startups use big data, how large corporations benefit, and what can be expected of a data scientist as a profession in the future. There’s also little nuggets of how to lie with big data and hide things you don’t want people to realize when visualize data with curves and diagrams. I find this essential to being a savvy consumer of news and political poles, and it will only get more and more relevant. Who wants to be a data journalist?

Does Strata Deliver?

So, does Strata deliver? Yes. The videos are well-done, sound is clear and the speakers are quite good. All the critical information is there to get up and running on the big data subject. If you know nothing about big data the Strata videos will get you up to speed. If you are looking to understand the potential impact of big data on future business Strata delivers. If you already are a data scientist you’ll probably find the bootcamp sessions redundant, but will no doubt find a lot of good info on the current state of the industry in the executive sessions. I may look back in five years and remark on how watching the Strata videos was a defining point in my career. However, remember that this is a really big set of videos, almost more of library than a conference. You’ll probably feel overwhelmed when you first look at the topic list, but skim over the topics and just start where it looks interesting. This is a video collection where you watch specific parts a few hours at a time, and not try to just crunch through all information in one night (or even in just one week), in fact, in may take you nearly a year.

Buy the Strata Conference 2011: Complete Video Compilation on O’Reilly.com