DataOps Management KPIs
Public Preview
DataOps Management KPIs measure data development and operations quality and performance. The KPIs are based on the DORA research program which seeks to understand the capabilities that drive software delivery and operations performance.
KPIs
DataOps Management KPIs are described in this table:
KPI | Category | Measurement | Impact Potential |
|---|---|---|---|
Deployment Frequency | Development | Average number of successful production deployment phases* per day. | Measure how often an organisation successfully releases to production and ultimately improve output. |
Commit Frequency | Development | Average number of commits per day. | Measure how often changes are committed, potential to improve velocity and quality through iteration. |
Lead Time for Changes | Development | Median lead time from commit to production deployment in days. If a commit was never deployed to production, using the next production deployment time of the package. | Measure how long it takes for commits to end up in production. Potential to improve velocity. |
Change Failure Rate | Development | Number of failed production deployment phases* divided by total number of production deployment phases. | Measure how many production deployments fail possibly causing a degradation in service. Potential to improve end user satisfaction by decreasing the number of outages. |
Load Failure Rate | Operations | Number of failed production load executions divided by total number of production load executions. | Measure how many production loads fail potentially causing data to not be refreshed or to be incorrect. Potential to improve end user satisfaction by decreasing the number of failures. |
Time to Restore Service (Deployments) | Operations | Average time between a failed production deployment phase* and the next successful production deployment. | Measure how long it takes to recover from failed deployments in production. Potential to improve end user satisfaction by decreasing the duration of outages. |
Time to Restore Service (Loads) | Operations | Average time between a failed production load and the next successful execution of that load. | Measure how long it takes to recover from failed production loads. Potential to improve end user satisfaction by decreasing the duration of outages. |
*Deployment phases include package deployments and workflow updates. There can be multiple package deployment phases in one deployment, and always one update workflows deployment phase:
DEPLOYMENT | PACKAGE_1 |
… | |
PACKAGE_N | |
UPDATE_WORKFLOWS |
Benchmarks
Benchmarks for DataOps Management KPIs are calculated as median from benchmark customers' monthly KPI figures. Benchmark customers are handpicked, they represent a variety of industries, and their solutions vary in size and practices. Note that benchmarks are only there to provide a baseline on how Agile Data Engine customers are doing on average on the selected KPIs; your figures may be different for a variety of reasons.