As data consumers increase, large organizations are having a hard time keeping up.
Data professionals in large organizations are dealing with various issues including stale data, lack of automation and anticipated disruption due to privacy and security requirements, according to a new survey by S&P and Immuta about data challenges in large organizations.
55% of respondents said the data they use for analysis is out-of-date by the time they use it. 40% said their organizations do not have a CDO; and a whopping 84% thought they’d run into roadblocks trying to navigate around data privacy rules.
From a release:
Supply Chain Challenges:
To better understand the friction in the data supply chain, the survey asked about specific pain points that data suppliers and data consumers face, finding that:
- 55% of all respondents either “somewhat” or “completely” agree that data is often stale or out-of-date by the time it is consumed or analyzed.
- 84% of respondents believe data privacy and security requirements will limit access to data at their organizations over the next 24 months.
- Among data suppliers, 38% report “lack of personnel or skills” and 29% report “not enough automation available” as top pain points.
- 90% of organizations report not having an “optimized” DataOps strategy. While most (85%) say that their strategy is accelerated, emerging, or nascent, few believe they have achieved DataOps maturity.
- For respondents from organizations slower to adopt cloud-based technologies, the top three reported barriers to adoption have to do with security (43%), compliance (40%), and data privacy (35%).
Notably, the report finds that regulation is actually a driver for improvement: organizations subject to data privacy and protection regulations, such as GDPR, are more likely to report having a cloud-first strategy, face fewer challenges with data access and use, are more likely to have a dedicated data engineering team, and more frequently provide self-service analytics programs.
“The disconnect between data suppliers and consumers highlights the pressing challenge for businesses and the public sector to improve speed and access to data,” said Matt Carroll, CEO of Immuta. “The findings make it clear that insights and business value cannot be quickly and easily generated from data unless it can be shared, modeled, and analyzed in a frictionless manner.”