Despite heavy challenges, enterprises that reported demonstrable data-to-insights capabilities saw the best bottom line outcomes in the survey.

Organizations that strategically invest in creating data-to-insights capabilities through modern data and analytics pipelines saw significant bottom line impact, according to a recent global study by IDC sponsored by Qlik.

The poll of 1,200 business leaders showed that companies with a higher ability to identify, gather, transform, and analyze data to glean insights were able to benefit from higher-quality decision making and better business outcomes. This also included improved operational efficiencies, increased revenue and increased profits.

Companies in the survey with the highest demonstrable data-to-insights capabilities, resulting in strong data pipelines that drive better decisions, saw significant bottom line impact:

  • 76% said operational efficiencyimproved by an average of 21%.
  • 75% said revenue increased by an average of 21%.
  • 74% said profit increased by an average of 22%.

Said Dan Vesset, Group Vice President, Analytics and Information Management at IDC: “Even in these challenging economic times, CEOs at major enterprises are continuing to invest in their data pipelines to close the gaps and enable their organizations with more high quality and valuable data for decisions. These leaders are increasing their enterprise intelligence quotient by automating the data preparation cycle through technology, giving employees the vital tools and time needed to analyze data for impactful insights that create real business value.”

Hurdles to data optimization

According to the study organizations are inundated with data, and many are struggling to maximize the value of that data since it is flowing through unintegrated and leaky data pipelines. The study has shown a direct relationship between creating stronger data-to-insights capabilities through data pipeline investments—ones that successfully deploy data management and analytics solutions to close pipeline gaps—to decision making that drives business outcomes. Notably:

  • 86% of organizations in the top half of those surveyed with the best data analytics pipelines also had the highest decision-making scores.
  • 67% of organizations in the top half of those surveyed with the highest decision-making scores had the highest business outcomes scores.

Yet, there are significant challenges to deploying data pipelines that drive better decisions and business outcomes. Organizations are dealing with complex and varied data types and sources, which can leak through data and analytics pipeline gaps. Of those surveyed, over 60% experienced significant challenges in assessing the value of data and identifying valuable data sources, often due to a lack of a data catalog. And over 42% surveyed identified assuring data correctness as a main challenge when processing or transforming data for analysis.

So, even as organizations invest in techniques like machine learning and AI to enhance insight generation and analysis, it is clear that the success of these investments is highly dependent on having an agile, automated and agnostic data pipeline that closes the gaps by working across any cloud, system and data source in real-time.

Only by closing these gaps to eliminate data leaks can organizations transform their data pipelines to provide continuous and reliable enterprise-ready data that drives action and outcomes. Said James Fisher, Chief Product Officer at Qlik: “Organizations must close the gaps in their leaky data pipelines to consistently transform their data into ongoing and real business value.”

Touting Qlik’s end-to-end approach to data integration and analytics, Fisher said organizations need the ability to improve their data-to-insights capabilities at the speed of business for greater responsiveness and better outcomes.