Breaking down the great global data challenge

United Kingdom, Jun 10, 2022

By Mark Benson, CTO, Logicalis UKI

There are plenty of statistics around the staggering amount of data being created and consumed globally every day. 2.5 quintillion (million million million) bytes created daily by internet users, a 5000% increase in data interactions between 2010 and 2020, and so on.  

For a casual observer, struggling to grasp the difference between an exabyte and a zettabyte, it is tempting to give up, consigning data to the same category as grains of sand on the beach or stars in the sky – just an unimaginably big number.  

Those who use data as a business asset can’t afford that luxury. They need to understand the sources of this data, what it means in business terms, and how to deliver maximum value from it.  

This blog considers where all this data is coming from, the drivers for future growth, and what this means for maximising business value from data. Other blogs in this series cover how to manage all this data effectively using Information Lifecycle Management (ILM) disciplines, and explain some key data management terms

What is driving data growth?  

To help understand what is driving the explosion in data, it is worth considering the different types and uses of data, their current and likely future contribution to growth, and the challenges they can present for organisations looking to manage and maximise data value.   

Until the 1990s, the bulk of data processed by IT consisted of the structured databases and files used by business systems and held on centralised or distributed corporate infrastructure. This data has seen largely linear growth as business system use has expanded, creating challenges around what to do with data that is no longer ‘live’ – retention policies, archiving and retrieval.   

The advent of the PC, then of an increasing range of mobile and consumer IT and storage devices, has driven an expansion in data stored locally, often duplicating that held on corporate resources. This has been a major contributor to the volume of dark data, defined by Gartner as “the information assets organizations collect, process and store during regular business activities, but generally fail to use for other purposes.” The existence of dark data raises challenges for organisations around investment in data storage, data security and compliance.    

While expanding corporate structured data use and IT device consumerisation have driven some growth, the explosive increase in data has come largely from the Internet and social media, and particularly from the massive increase in unstructured media. Digital video and sound media are generally orders of magnitude larger than data files, so they have a disproportionate effect on growth measured in bytes. Organisations face the challenge of how best to manage and exploit this ever-growing ocean of unstructured data.  

The Internet of Things (IoT), automation, machine learning and Artificial Intelligence (AI) create a new level and volume of complex digital transactions, which in turn create a new level of data management requirements. Increasingly intelligent technology should grow the capability to automate management and exploitation of all this data, but there are likely still to be challenges in assuring compliance and security and maintaining human oversight of how data is used.        

Image

 

How should organisations respond?  

The first steps for any organisation looking to maximise value from data are to have a data strategy that is fully aligned with business strategy, and to make sure that all the data it owns is under control through robust Information Lifecycle Management (ILM).  

This should focus data activity on the right business priorities, eliminate waste and business risk around data retention and dark data, and provide a solid foundation for deploying the ever-growing range of technology capabilities for exploiting both structured and unstructured data to the full.      

What next? 

Logicalis UKI have helped many clients deliver success in managing and maximising value from data.  

Download our eBook to find out more about the critical role of data management in digital business, or visit our website here to find out more.  

Topic

Related Insights

United Kingdom, Nov 23, 2022

Blogs

How to Continue Transforming During a Recession

With the current economic slowdown, it looks like another recession could be on the cards in 2023. This usually heralds a period of consolidation within IT and the closing of the purse strings with regards to planned investments. In previous decades this was standard practice, but now that we’re in a digital age, many businesses can’t afford to slow down their digital transformations if they want to survive.

Learn more

United Kingdom, Nov 23, 2022

Blogs

Reducing Digital Waste

Sustainability is imperative to all our futures and is directly impacted by every device we use that consumes power. This includes the on-premises and cloud infrastructures that power our digital work lives. To be as sustainable as possible we need to ensure that we are consuming the least amount of infrastructure to host our workloads and services, without impacting their availability, performance or governance.

Learn more
Advisory Services von Logicalis

, Sep 16, 2022

News

Only a third of CIO's cite cyber-risk mitigation as a performance measure

London, 21 March 2022: While 94% of CIOs acknowledged some form of serious threat over the next 12 months, only 27% listed business continuity and resilience as a top-three priority during the next 12 months and barely a third cited risk mitigation as a measure of performance. These findings come from the fourth section of the 2021 Global CIO Survey from Logicalis, a global provider of IT solutions.
Learn more

United Kingdom, Jun 23, 2022

Blogs

How to make the most of chatbots

Chatbots are all around us. Visit any eCommerce website today and the chances are it’ll instantly present you with a ‘How can I help you today?’ pop-up. The global market for intelligent virtual assistants is expected to grow at a CAGR of 28.5% from 2021 to 2028, and social media is full of amusing stories of parrots and small children wreaking havoc via Alexa.

Learn more

United Kingdom, Jun 20, 2022

Blogs

A brief guide to Business Process Management (BPM)

Effective Business Process Management (BPM) is an essential foundation for any successful business digitalisation and automation strategy. In summary, you can’t successfully automate a process unless you understand it fully, and BPM provides this understanding.

Learn more

United Kingdom, Jun 3, 2022

Blogs

Explaining some important data management concepts and terms

Recent Logicalis UKI eBooks and articles have focused on the critical role of data in digital business, from unstructured data and the role of Information Lifecycle Management to the importance of robust, business-driven data storage strategy.

Learn more

United Kingdom, Jun 1, 2022

Blogs

How multi cloud data fabrics maximise data value

As data becomes an increasingly valuable asset, organisations have to adapt, to manage and protect their data to ensure it delivers maximum value to the business.

Learn more

United Kingdom, May 30, 2022

Blogs

Why data storage trends are about more than just technology

There are plenty of informative and valuable articles on the web about trends in data storage technology, discussing everything from reducing last byte latency to the wonders of consumption-based pricing. Data and storage are hot topics, unsurprisingly in an age where, as Mckinsey puts it, ‘“digital” and “data” have become the talk of the town.’

Learn more

United Kingdom, May 25, 2022

Blogs

Is it time to stop talking about the death of tape storage?

Heritage technologies - mainframe, Unix and magnetic tape in particular – have long been a rich source for the ‘is x technology dead?’ debate. Technical pundits fill the web with head scratching over why they haven’t disappeared, or defences for their survival.

Learn more

United Kingdom, May 20, 2022

Blogs

How to avoid the pitfalls of ‘good enough’ IT

In challenging economic times, organisations naturally look to cut back or defer non-essential investment. IT spend has traditionally been one of the areas businesses look to first when the need arises to cut budgets or delay projects, sometimes creating a ‘good enough IT’ mindset, where any IT asset that is doing the job reasonably effectively today is maintained beyond the last responsible moment for replacement.

Learn more

United Kingdom, May 16, 2022

Blogs

Should we stop being ageist about Unix?

"Unix is dead, long live Unix" – a headline that is still as topical today as it was in 2009, when a blog with that title was published to mark Unix’s 40th birthday.

Learn more

United Kingdom, May 13, 2022

Blogs

Where next for Virtualisation?

In its broadest sense, virtualisation can be seen as the progressive freeing up of any computing function – compute, storage, network – from the constraints of its physical infrastructure. So far, virtualisation has been a continuous evolution, from the first virtual machines (VMs) to the world of hybrid cloud, and there is no sign yet of this evolution losing momentum.

Learn more

United Kingdom, Feb 21, 2022

News

The Changing Threat Landscape

The range and impact of Information Security (IS) threats has grown and changed continually over the last 40 years or more, along with the motivations and drivers for such attacks. From when the Morris Worm launched the first, apparently inadvertent, distributed denial-of-service (DDoS) attack on the internet, the realm of cybercrime has expanded from hackers often driven by little more than curiosity, to organised crime and state sponsorship.
Learn more