Metrics for the Insights “Workflow Summary” endpoints (#1 & #2) do not currently include data from on-hold workflows, only completed workflows are used.
In certain situations, this can lead to inaccurate credit usage metrics for specific workflows that use approval jobs.
Starting April 21, 2023, Insights credits and total runs metrics from the endpoints #1 & #2 linked above will use data from all workflows including on-hold workflows.
Consumers of the credits and total runs metrics from Insights may see an increase in each of these respective metrics. This change represents a more accurate way of reporting on CircleCI’s usage.
Note: Insights duration metrics will continue to only use completed workflows. As part of this transition,
completed_runs will be a new metric that is provided as part of the Insights API in order to provide a way to access the previous methodology of calculating total runs (ie. excluding on-hold workflows).