Top 10 data and analytics technology trends for 2021: Gartner

Gartner, Inc. identified the top 10 data and analytics technology trends for 2021 that can help organizations respond to change, uncertainty and the opportunities they bring in the next year.

“The speed at which the COVID-19 pandemic disrupted organizations has forced D&A leaders to have tools and processes in place to identify key technology trends and prioritize those with the biggest potential impact on their competitive advantage,” said Rita Sallam, distinguished research vice president at Gartner.

Trend 1: Smarter, Responsible, Scalable AI

The greater impact of artificial intelligence (AI) and machine learning (ML) requires businesses to apply new techniques for smarter, less data-hungry, ethically responsible and more resilient AI solutions. By deploying smarter, more responsible, scalable AI, organizations will leverage learning algorithms and interpretable systems into shorter time to value and higher business impact.

Trend 2: Composable Data and Analytics

Open, containerized analytics architectures make analytics capabilities more composable. Composable data and analytics leverages components from multiple data, analytics and AI solutions to rapidly build flexible and user-friendly intelligent applications that help D&A leaders connect insights to actions.

With the center of data gravity moving to the cloud, composable data and analytics will become a more agile way to build analytics applications enabled by cloud marketplaces and low-code and no-code solutions.

Trend 3: Data Fabric Is the Foundation

With increased digitization and more emancipated consumers, D&A leaders are increasingly using data fabric to help address higher levels of diversity, distribution, scale and complexity in their organizations’ data assets.

The data fabric uses analytics to constantly monitor data pipelines. A data fabric utilizes continuous analytics of data assets to support the design, deployment and utilization of diverse data to reduce time for integration by 30%, deployment by 30% and maintenance by 70%.

Trend 4: From Big to Small and Wide Data

The extreme business changes from the COVID-19 pandemic caused ML and AI models based on large amounts of historical data to become less relevant. At the same time, decision making by humans and AI are more complex and demanding, requiring D&A leaders to have a greater variety of data for better situational awareness.

As a result, D&A leaders should choose analytical techniques that can use available data more effectively. D&A leaders rely on wide data that enables the analysis and synergy of a variety of small and large, unstructured, and structured data sources, as well as small data which is the application of analytical techniques that require less data but still offer useful insights.

“Small and wide data approaches provide robust analytics and AI, while reducing organizations’ large data set dependency,” said Ms. Sallam. “Using wide data, organizations attain a richer, more complete situational awareness or 360-degree view, enabling them to apply analytics for better decision making.”

Trend 5: XOps

The goal of XOps, including DataOps, MLOps, ModelOps, and PlatformOps, is to achieve efficiencies and economies of scale using DevOps best practices, and ensure reliability, reusability and repeatability. At the same time, it reduces duplication of technology and processes and enabling automation.

Most analytics and AI projects fail because operationalization is only addressed as an afterthought. If D&A leaders operationalize at scale using XOps, they will enable the reproducibility, traceability, integrity and integrability of analytics and AI assets.

Trend 6: Engineering Decision Intelligence

Engineering decision intelligence applies to not just individual decisions, but sequences of decisions, grouping them into business processes and even networks of emergent decisions and consequences. As decisions become increasingly automated and augmented, engineering decisions give the opportunity for D&A leaders to make decisions more accurate, repeatable, transparent and traceable.

Trend 7: Data and Analytics as a Core Business Function

Instead of being a secondary activity, D&A is shifting to a core business function. In this situation, D&A becomes a shared business asset aligned to business results, and D&A silos break down because of better collaboration between central and federated D&A teams.

Trend 8: Graph Relates Everything

Graphs form the foundation of many modern data and analytics capabilities to find relationships between people, places, things, events and locations across diverse data assets. D&A leaders rely on graphs to quickly answer complex business questions which require contextual awareness and an understanding of the nature of connections and strengths across multiple entities.

Gartner predicts that by 2025, graph technologies will be used in 80% of data and analytics innovations, up from 10% in 2021, facilitating rapid decision making across the organization.

Trend 9: The Rise of the Augmented Consumer

Most business users are today using predefined dashboards and manual data exploration, which can lead to incorrect conclusions and flawed decisions and actions. Time spent in predefined dashboards will progressively be replaced with automated, conversational, mobile, and dynamically generated insights customized to a user’s needs and delivered to their point of consumption.

“This will shift the analytical power to the information consumer — the augmented consumer — giving them capabilities previously only available to analysts and citizen data scientists,” said Ms. Sallam.

Trend 10: Data and Analytics at the Edge

Data, analytics and other technologies supporting them increasingly reside in edge computing environments, closer to assets in the physical world and outside IT’s purview. Gartner predicts that by 2023, over 50% of the primary responsibility of data and analytics leaders will comprise data created, managed, and analyzed in edge environments.