Story image

Big data: Could the end really be in sight?

01 Aug 2016

I can’t say I love the term Big Data. How big is big? When it comes to data, often what was big last year is just the norm this year.

What I am sure about is that Big Data is Massive now. Big just doesn’t do it justice.  The great thing for data is that it has a perfect mate in the “Internet of Things”. Once IoT and data get their act together we’ll really start to appreciate just how big it can get. When everything we use is connected and interacting, data is going to increase exponentially, and we’ll need some new hyperbolic terminology to describe it.

The thing that has struck me recently is just how the NZ business community is only just beginning to scratch the surface of managing their data. I was pleased to see how our utilities, banking and FMCG industries are basing their growth around data management. I was even more pleased that our healthcare providers, particularly private hospitals, are using analytics to improve their services. The fact that both these industries are really in their infancy when it comes to using their data to drive their business decisions just shows how much there is to go.

The thing about Big Data is that, Big is not necessarily good. If you don’t use a fraction of that data you have access to then you are just overpaying for storage space. Increasingly data will be seen as strategically important for medium and small sized enterprises as they seek insights into the huge amount of data they keep, it’s what they do with it that matters.

Traditional reporting tends to be retrospective, however analytics has a predictive focus which requires more sophisticated data modelling and analysis tools. Good news is that the tools for this are becoming simpler all the time and will eventually take the analysis away from the IT team and into the hands of the business.

Fewer reports will be on spreadsheets and more will be in easily interpreted graphical formats using data visualisation tools to highlight patterns and trends. When it comes to a business getting the competitive edge it’s essential that results are easily interpreted by the business leaders.

Clean, Fast and Useful data will become more important than Big. That is easier said than done as data is notoriously tricky. Apart from taking various guises or formats it also lives in different places and even hides in the cloud. Yet, as data usage grows, so does our expectations of visualisation and insights. At some stage in the not too distant future machine learning and automated algorithms will allow us to order and process our data. For now however, we’ll have to remain manual with Datawarehousing and Business Intelligence Consultants providing the hard work behind a data driven business culture. It’s likely that companies will start to look towards a Chief Data Officer to guide us through this business transformation.

What is pleasing is that most businesses I talk to; using data to grow their business, do so from the perspective of customer centricity – by providing a service or product better to the customer than their competitors. As the IoT becomes a reality, where every device or appliance we use reports back something about us, the potential for services to be tailored specifically for an individual is enormous. I’m happy that my doctor will predict when I need a health check up based on my eating habits and little of consequence coming back from my fitness app.  Of course this is also a scary prospect. Soon there will be nowhere to hide and there’s a whole new discussion to be had on privacy and security.

So, yes, this is the end for Big Data. When it’s this big I don’t think we need it pointed out anymore. 

Article by Ashley Sadler, Madison Recruitment

Chch crypto exchange Cryptopia facing liquidation
It seems that Christchurch-based cryptocurrency exchange Cryptopia has been unable to recover after malicious cyber attackers stole around $20 million worth of cryptocurrency.
Adobe & Amazon: Making merchants' stores a lot more powerful
Magento Commerce branded stores for Amazon sellers features native integration with Amazon merchant tools including Amazon Pay and Fulfillment by Amazon. These provide the convenience of secure payments and speedy shipping services for buyers.
Four NZ projects shortlisted in IDC's APAC Smart Cities Awards
The annual awards highlight and acknowledge outstanding smart city initiatives in the Asia Pacific region and this year attracted over 180 entries.
How Chorus aims to reshape service company maintenance contracts
“These contracts are the first step in moving Chorus beyond the major UFB network build."
Mind Lab at MOTAT hosting event to promote young women in tech
Gender diversity in the tech industry is a hot topic around the world, but it’s one that New Zealand is looking to tackle head on.
SOLD: Infratil & partner snap up Vodafone NZ
Brookfield Asset Management and Infratil will hand over NZ$3.4 billion to acquire Vodafone New Zealand.
Noise pollution is the new second-hand smoke
ow loud is our phone call? Can you hear your co-worker’s music through their headphones? Do you need to have that meeting in a public area of the office?
Infratil throws its hat into the buyer's market for Vodafone NZ
Vodafone has been through a turbulent time lately, after the threat of staff redundancies, constant fines from the Commerce Commission, and the addition of Vodafone CEO Jason Paris late last year.