Kanban QUALITY KPIs

Ticket open vs closed rate by type

gives a comparison of new tickets getting raised vs number of tickets getting closed grouped by issue type during a defined period. 

Line + Column graph

• Y- Axis - Count 

• X- Axis - Weeks

• Aggregation Method - Sum

• Positive Trend - If the No. of tickets closed are more than the No. of tickets opened in the latest time period

Agile Project Management

• Jira

• Azure

N/A

, the KPI is considered having a positive trend

Date Range- Count

Ticket Open vs Closed rate by Priority

gives a comparison of new tickets getting raised vs number of tickets getting closed grouped by priority during a defined period. 

Line + Column graph

• Y- Axis - Count (Days)

• X- Axis - Weeks

• Aggregation Method - Sum

• Positive Trend - If the No. of tickets closed are more than the No. of tickets opened in the latest time period

Agile Project Management

• Jira

• Azure

N/A

If the No. of tickets closed are more than the No. of tickets opened in the latest time period, the KPI is considered having a positive trend

Date Range- Count

Net Open Ticket Count By Priority

measures the overall open tickets during a defined period grouped by priority. It considers the gross open and closed count during a period and then plots the net counts

Line chart

• Y- Axis - Count (Days)

• X- Axis - Weeks

• Aggregation Method - Sum

• Positive Trend - Decrease in net open ticket count

Agile Project Management

• Jira

• Azure

N/A

Date Range- Count

Net Open Ticket Count By RCA (Ticket Count By RCA)

measures the overall open tickets during a defined period grouped by RCA. It considers the gross open and closed count during a period and then plots the net count

Line chart

• Y- Axis - Count (Days)

• X- Axis - Weeks

• Aggregation Method - Sum

• Positive Trend - Decrease in net open ticket count

Agile Project Management

• Jira

• Azure

N/A

Date Range- Count

Net Open Ticket count by Status (Total Ticket Count)

measures the overall open tickets during a defined period grouped by Status. It considers the gross open and closed count during a period and then plots the net count

Line chart

• Y- Axis - Count

• X- Axis -Weeks

• Aggregation Method - Sum

• Positive Trend - Decrease in net open ticket count

Agile Project Management

• Jira

• Azure

N/A

Date Range- Count

Open Tickets Ageing by Priority (Total Tickets Aging)

groups all the open tickets based on their ageing and priority

Line chart

• Y- Axis - Count (Days)

• X- Axis - As defined currently

• Aggregation Method - Average

Agile Project Management

• Jira

• Azure

N/A

Open tickets by ageing

Date Range- Count

Regression automation Coverage

measures progress of automation of regression test cases 

Line chart

• Y- Axis - Percentage

• X- Axis - Weeks

• Aggregation Method - Average

• Positive trend indication - Increase

Agile Project Management

• Jira

• Azure

• Zephyr

M1 - <20%

M2 - 20-40%

M3 - 40-60%

M4 - 60% - 80% , 

M5 - > 80%

No. of regression test cases automated/Total no. of regression test cases

• It is calculated as a ‘Percentage’. Higher the percentage, better is the ‘Quality’

• Maturity of the KPI is calculated based on the average of last 5 values that corresponds with the maturity scale

Date Range: <<Percentage Value>>

Regression test cases automated: <<Value>>

Total Regression test cases: <<Value>>

Unit Test Coverage

is a measurement of the amount of code that is run by unit tests - either lines, branches, or methods

Line Graph with single-select filter

 Y- Axis - Percentage

• X- Axis - Weeks

• Aggregation Method - Average

• Positive trend indication - Increase

Agile Project Management

• SonarQube

M1 - <20%

M2 - 20-40%

M3 - 40-60%

M4 - 60% - 80% , 

M5 - > 80%

The calculation is done directly in Sonarqube

• It is calculated in ‘Percentage’. Higher the percentage, better is the ‘Quality’

• Maturity of the KPI is calculated based on the latest value

Date Range: << Percentage Value>>

Sonar Violations

highlight count of issues that exist every time a piece of code breaks a coding rule. The set of coding rules is defined through the associated Quality profile for each programming language in the project.

Stacked Column

• Y- Axis - Count

• X- Axis - Weeks

• Aggregation Method - Sum

• Positive trend indication - Decrease

Agile Project Management

• SonarQube

No Maturity Trend

The calculation is done directly in Sonarqube. 

Issues are categorized in 3 types: Bug, Vulnerability and Code Smells

All these issues are categorized into 5 type of severity: Blocker, Critical, Major, Minor, Info   

Date Range:

Blocker: <<Value>>

Critical: <<Value>>

Major: <<Value>>

Minor: <<Value>>

Info: <<Value>>

Sonar Tech Debt

explains the estimated time required to fix all Maintainability Issues/ code smells

Line Graph

• Y- Axis - Days

• X- Axis - Weeks

• Aggregation Method - Sum

• Positive trend indication - Decrease

Agile Project Management

• SonarQube

M1: >100 days 

M2: 50-100 days

M3: 30-50 days,

M4: 10-30 days,

M5: <10 days

It is calculated as effort to fix all Code Smells. The effort is calculated in minutes and converted to days by assuming 1 Day=8 Hours 

• It is calculated in ‘Days’. Lower the days, better is the ‘Quality’

• Maturity of the KPI is calculated based on the latest value

Date Range:<<Days>>

Test Execution and pass percentage

measures the percentage of test cases that have been executed & the percentage that have passed.

Line Graph + Column chart

• Y- Axis - Percentage

• X- Axis - Sprints

• Aggregation Method - Average

• Positive trend indication - Increase

Agile Project Management

• Excel

M1 - <20%

M2 - 20-40%

M3 - 40-60%

M4 - 60% - 80% , 

M5 - > 80%

No. of executed test cases out of total test cases in the latest execution during a day/week/month

No. of pass test cases out of executed test cases in  the latest execution during a day/week/month

• It is calculated in ‘Percentage’. Higher the percentage, better is the ‘Quality’

• Maturity of the KPI is calculated based on the average of last 5 values that corresponds with the maturity scale

Date Range- <<Percentage Value>>

Test Cycle: 

Executed test cases: <<Value>>

Pass test cases: <<Value>>