Monte Carlo announced
Data Reliability Dashboard, a new functionality to help customers better
understand and communicate the reliability of their data. The announcement was
made at IMPACT 2022, the company's annual Data Observability Summit, held both virtually and in-person October 25-26,
2022.
Poor data quality costs companies a tremendous amount of
money, impacting over 26% of their revenue according to a recent survey by Wakefield Research.
It also wastes precious time, with data engineers spending upwards of 40 percent of
their time - or 120 hours per week -
dealing with bad data.
Data Reliability Dashboard helps teams tackle this
problem by providing a bird's eye view of data reliability metrics over time
and aligning data teams and their stakeholders on data health.
This is the latest in a series of improvements Monte
Carlo has made to help customers drive data reliability and eliminate data
downtime, including Circuit Breakers, a
new way to automatically stop broken data pipelines; Insights, a
functionality that offers operational analytics in the health of a company's
data platform; and native integrations with dbt, Databricks, and Airflow.
"Data leaders know data reliability is important, but
typically lack the tools to measure it. Monte Carlo's Data Reliability
Dashboard will bridge this divide and provide better tracking for critical KPIs
such as pipeline and data quality metrics; time-to-response and resolution for
critical incidents; and other important data SLAs," said Lior Gavish, CTO and
co-founder, Monte Carlo. "This new functionality will also give data
practitioners and leaders a common language to measure and improve the quality
of their data platforms, as well as the ROI across their data products."
Available in Q4 2022, the Data Reliability Dashboard will
focus on three main areas that will help leaders better understand the data
quality efforts that are happening in their organization:
- Stack Coverage: Overall view of the extent of monitoring and
observability coverage in their stack, to make sure operational best
practices are being adopted.
- Quality Metrics: Data reliability KPIs around the 5 pillars of data
observability, which helps observe trends and validate progress
as reliability investments are made.
- Incident Metrics and Usage: Measures of time to
detection and time to resolution of data incidents, as well as user
engagement metrics with said incidents. This allows teams to measure and
improve the quality of their incident response operations, thus minimizing
data downtime and optimizing data trust.
- During IMPACT 2022, Monte Carlo announced additional
data observability capabilities, including:
- Visual Incident Resolution: Data engineers can now
use an interactive map of their data lineage to diagnose and troubleshoot
data breakages. With this new release, Monte Carlo places freshness,
volume, dbt errors, query logs, and other critical troubleshooting data in
a unified view of affected tables and their upstream dependencies. This
radically accelerates the incident resolution process, allowing data
engineers to correlate all the factors that might contribute to an
incident on a single screen.
- Integration with Power BI: This new
integration allows data engineering teams to properly triage data
incidents that impact Power BI dashboards and users as well as proactively
ensure that changes to upstream tables and schema can be executed safely.
As a result, Power BI analysts and business users can confidently utilize
dashboards knowing the data is correct.