Definition (Hover Text)

Measures progress of automation of test cases linked to stories within the iteration  

Source Tools

• Zephyr

• Jira Test

Graph type

Line Chart

Filters

-

Hover Format on KPI

Sprint Name: <<Percentage Value>>

Linked test cases automated: <<Value>>

Total linked test cases: <<Value>>

Fields on Overlay

• Sprint Name

• Test case ID

• Linked Story ID

• Automated

Business Logic

Calculation Formula

No. of test cases linked to stories in iteration that are automated/Total test cases linked to stories in iteration

Example:

Let’s say your team has the following data at the end of an iteration:

• Total number of regression test cases available: 100

• Number of regression test cases automated: 60

Using the formula, the Insprint Automation Coverage would be calculated as follows:

Insprint Automation Coverage =60 / 100 ​=0.6 or 60%

Trend

Higher the percentage, better is the ‘Quality’

Maturity Levels

M1 - <20%

M2 - 20-40%

M3 - 40-60%

M4 - 60% - 80% , 

M5 - > 80%

Instance level thresholds

-

Configurations

Processor Fields

NA

KPI Specific fields

• Workflow Status Mapping

  • KPI calculation logic

How to Validate KPI

Suggested ways of working

Sample JQLs

Best Practice

Prioritize Test Cases

Automate test cases for areas of the application that undergo frequent changes.

Maintain Test Scripts

Regularly update and maintain test scripts to ensure they remain effective and relevant.

Refactor test scripts to improve readability and maintainability.

Monitor and Review

Regularly monitor the progress of automation and review the effectiveness of automated tests.

Establish a feedback loop to continuously improve the automation process based on test results and team feedback.

Benefits of KPI

Efficiency

Automated tests can be run repeatedly with the same accuracy, ensuring consistent results.

Cost Savings

Automated tests can catch defects early in the development cycle, reducing the cost of fixing them later

Improved Quality

Automation allows for more extensive testing, covering more scenarios and edge cases.
Automated tests are less prone to human error, ensuring more reliable test results.

Continuous Integration

Automated tests can be integrated into the CI/CD pipeline, enabling continuous testing and faster feedback.