Five Things CIO’s Should Know About Big Data
#1 You will need to think about big data
Big data analysis got its start from the large Web service providers such as Google, Yahoo and Twitter, which all needed to make the most of their user generated data. But enterprises will big data analysis to stay competitive, and relevant, as well.
You could be a really small company and have a lot of data. A small hedge fund may have terabytes of data, said Jo Maitland, GigaOm research director for big data. In the next couple of years, a wide number of industries–including health care, public sector, retail, and manufacturing–will all financially benefit by analyzing more of their data, consulting firm McKinsey and Company anticipated in a recent report.
There is an air of inevitability with Hadoop and big data implementations, said Eric Baldeschwieler, chief technology officer of Hortonworks, a Yahoo spinoff company that offers a Hadoop distribution. It’s applicable to a huge variety of customers. Collecting and analyzing transactional data will give organizations more insight into their customers’ preferences. It can be used to better inform the creation of new products and services, and allow organizations to remedy emerging problems more quickly.
#2 Useful data can come from anywhere (and everywhere)
You may not think you have petabytes of data worth analyzing, but you will, if you don’t already. Big data is collected data that used to be “dropped on the floor,” Baldeschwieler said.
Big data could be your server’s log files, for instance. A server keeps track of everyone who checks into a site, and what pages they visit when they are there. Tracking this data can offer insights into what your customers are looking for. While log data analysis is nothing new, it can be done don to dizzying new levels of granularity.
Another source of data will be sensor data. For years now, analysts have been speaking of the Internet of Things, in which cheap sensors are connected to Internet, offering continual streams of data about their usage. They could come from cars, or bridges, or soda machines.”The real value around the devices is their ability to capture the data, analyze that information and drive business efficiencies,” said Microsoft Windows Embedded General Manager Kevin Dallas.
#3 You will need new expertise for big data
When setting up a big data analysis system, your biggest hurdle will be finding the right talent who knows how to work the tools to analyze the data, according to Forrester Research analyst James Kobielus.
Big data relies on solid data modeling. Organizations will have to focus on data science, Kobielus said. They have to hire statistical modelers, text mining professionals, people who specialize in sentiment analysis. This may not be the same skill set that todays analysts versed in business intelligence tools may readily know.
Such people may be in short supply. By 2018, the United States alone could face a shortage of 140,000 to 190,000 people with deep analytical skills as well as 1.5 million managers and analysts with the know-how to use the analysis of big data to make effective decisions, McKinsey and Company estimated.
See more here: Five Things CIO’s Should Know About Big Data
