Test Management Metrics Guide
- AngusTester's key metrics for test management help teams quantify testing effectiveness, improve software quality, and optimize testing processes.
- Data-driven decision-making enables predictable, measurable, and optimizable testing processes.
Click to view Test Metrics Features
Core Value
- Quality Visualization: Real-time insight into defect distribution and resolution progress
- Resource Optimization: Precise allocation of testing manpower and time
- Efficiency Improvement: Shorten testing cycles and enhance testing efficiency
- Risk Control: Early identification of quality risks and schedule deviations
Progress Metrics
💡 Quantitative view of testing progress
| Metric | Description | Parameter Name | Calculation Formula |
|---|---|---|---|
| Total Test Cases | Number of all test cases in the project/test plan | totalNum | N/A |
| Completed Cases | Number of executed test cases | completedNum | N/A |
| Completion Rate | Percentage of completed test cases | completedRate | (completedNum / totalNum) × 100% |
| Total Workload | Estimated total workload for testing (hours/story points) | evalWorkload | N/A |
| Completed Workload | Actual workload invested in testing | completedWorkload | N/A |
| Workload Completion Rate | Percentage of completed workload | completedWorkloadRate | (completedWorkload / totalWorkload) × 100% |
Burn-down Chart Metrics
💡 Visual tool for tracking testing progress
Test Case Burn-down Metrics
| Metric | Description | Parameter Name | Calculation Formula |
|---|---|---|---|
| Total Cases | Total number of test cases | total | N/A |
| Completed Cases | Number of completed cases | completed | N/A |
| Remaining Cases | Number of pending cases | remained | total - completed |
Workload Burn-down Metrics
| Metric | Description | Parameter Name | Calculation Formula |
|---|---|---|---|
| Total Workload | Estimated workload for all cases | total | N/A |
| Completed Workload | Actual workload spent on completed cases | completed | N/A |
| Remaining Workload | Estimated workload for pending cases | remained | total - completed |
Workload Metrics
💡 Core measurements of testing efficiency
| Metric | Description | Parameter Name | Calculation Formula |
|---|---|---|---|
| Estimated Workload | Initial workload estimate for test cases | evalWorkload | N/A |
| Actual Workload | Real effort spent during test execution | actualWorkload | N/A |
| Completed Workload | Actual workload for completed cases | completedWorkload | N/A |
| Workload Completion Rate | Percentage of completed workload | completedWorkloadRate | (completedWorkload / evalWorkload) × 100% |
| Saved Workload | Difference between estimated and actual workload (positive = savings) | savingWorkload | evalWorkload - actualWorkload |
| Workload Savings Rate | Percentage of saved workload | savingWorkloadRate | (savingWorkload / evalWorkload) × 100% |
Overdue Assessment Metrics
💡 Early warning system for testing risks
| Metric | Description | Parameter Name | Calculation Formula |
|---|---|---|---|
| Overdue Risk Level | Likelihood of delay based on progress assessment | riskLevel | Comprehensive evaluation |
| Total Test Cases | Total number of test cases | totalNum | N/A |
| Total Workload | Estimated total workload for all cases | totalWorkload | N/A |
| Overdue Cases | Number of cases exceeding planned completion time | overdueNum | N/A |
| Overdue Rate | Percentage of overdue cases | overdueRate | (overdueNum / totalNum) × 100% |
| Overdue Workload | Total workload of overdue cases | overdueWorkload | Sum of overdue case workloads |
| Workload Overdue Rate | Percentage of overdue workload | overdueWorkloadRate | (overdueWorkload / totalWorkload) × 100% |
| Daily Average Workload | Team's average daily completed workload | dailyProcessedWorkload | Total completed workload / working days |
| Overdue Duration (hours) | Cumulative overdue time for all overdue cases | overdueTime | Sum of overdue times |
| Estimated Processing Time for Overdue Workload (hours) | Estimated time to complete overdue workload | overdueWorkloadProcessingTime | overdueWorkload / dailyProcessedWorkload |
Overdue Risk Level Standards:
- 🟢 No Risk: No overdue cases
- 🟡 Low Risk: Overdue workload ≤ 3 days
- 🔴 High Risk: Overdue workload > 3 days
Defect Submission Metrics
💡 Core measurements of software quality
| Metric | Description | Parameter Name | Calculation Formula |
|---|---|---|---|
| Total Defects | Total number of defects found during testing | bugNum | N/A |
| Defect Rate | Proportion of defect-related tasks | bugRate | Total defects / total tasks |
| Valid Defects | Number of confirmed genuine defects | validBugNum | N/A |
| Defect Validity Rate | Percentage of valid defects | validBugRate | (validBugNum / bugNum) × 100% |
| First-pass Defects | Defects resolved successfully after first fix | oneTimePassedBugNum | N/A |
| First-pass Rate | Percentage of first-pass defects | oneTimePassedBugRate | (oneTimePassedBugNum / total passed defects) × 100% |
| Test Hits | Number of defects triggered by test cases | - | N/A |
| Test Hit Rate | Percentage of test cases triggering defects | - | Test hits / total cases × 100% |
Defect Severity Standards:
- ⚠️ Critical: System crash/core functionality failure
- 🔥 Major: Key functionality failure, high priority
- ⚙️ Normal: Functional defect without blocking main flow
- 📝 Minor: Low-priority issues like typos
Test Efficiency Analysis
💡 Evaluate test execution efficiency and software stability
| Metric | Description | Parameter Name | Calculation Formula |
|---|---|---|---|
| Total Test Cases | Total number of test cases | totalNum | N/A |
| Passed Cases | Number of successfully executed cases | passedTestNum | N/A |
| Pass Rate | Percentage of passed cases | passedTestRate | (passedTestNum / totalNum) × 100% |
| First-pass Cases | Cases passed on first execution | oneTimePassedNum | N/A |
| First-pass Rate | Percentage of first-pass cases | oneTimePassedRate | (oneTimePassedNum / totalNum) × 100% |
| Second-pass Cases | Cases passed after one fix | twoTimePassedNum | N/A |
| Second-pass Rate | Percentage of second-pass cases | twoTimePassedRate | (twoTimePassedNum / totalNum) × 100% |
| First-fail Cases | Cases failed on first execution | oneTimeNotPassedNum | Passed cases - first-pass cases |
| First-fail Rate | Percentage of first-fail cases | oneTimeNotPassedRate | (oneTimeNotPassedNum / totalNum) × 100% |
Core KPI Metrics
💡 Key indicators for team efficiency and quality
| Metric | Description | Parameter Name | Calculation Formula |
|---|---|---|---|
| Total Test Cases | Total number of test cases | totalNum | N/A |
| Completed Cases | Number of completed cases | completedNum | N/A |
| Completion Rate | Percentage of completed cases | completedRate | (completedNum / totalNum) × 100% |
| Total Workload | Estimated total workload | evalWorkload | N/A |
| Completed Workload | Actual workload spent | completedWorkload | N/A |
| Workload Completion Rate | Percentage of completed workload | completedWorkloadRate | (completedWorkload / totalWorkload) × 100% |
| Total Overdue Cases | Number of cases exceeding planned time | overdueNum | N/A |
| Overdue Rate | Percentage of overdue cases | overdueRate | (overdueNum / totalNum) × 100% |
| Completed Overdue Cases | Number of completed overdue cases | completedOverdueNum | N/A |
| Overdue Completion Rate | Percentage of completed overdue cases | completedOverdueRate | (completedOverdueNum / overdueNum) × 100% |
| Total Reviews | Number of cases requiring review | reviewNum | N/A |
| Review Rate | Percentage of cases needing review | reviewRate | (reviewNum / totalNum) × 100% |
| Approved Reviews | Number of approved reviews | completedReviewNum | N/A |
| Review Approval Rate | Percentage of approved reviews | completedReviewRate | (completedReviewNum / reviewNum) × 100% |
Review Efficiency Metrics
💡 Evaluate test case quality and review efficiency
| Metric | Description | Parameter Name | Calculation Formula |
|---|---|---|---|
| Total Cases | Total cases submitted for review | totalNum | N/A |
| Approved Cases | Number of approved cases | passedReviewNum | N/A |
| Approval Rate | Percentage of approved cases | passedReviewRate | (passedReviewNum / totalNum) × 100% |
| First-pass Approvals | Cases approved on first review | oneTimePassedReviewNum | N/A |
| First-pass Rate | Percentage of first-pass approvals | oneTimePassedReviewRate | (oneTimePassedReviewNum / totalNum) × 100% |
| Second-pass Approvals | Cases approved after one revision | twoTimePassedReviewNum | N/A |
| Second-pass Rate | Percentage of second-pass approvals | twoTimePassedReviewRate | (twoTimePassedReviewNum / totalNum) × 100% |
Backlog Metrics
💡 Manage testing backlog and resource allocation
| Metric | Description | Parameter Name | Calculation Formula |
|---|---|---|---|
| Total Cases | Total number of test cases | totalNum | N/A |
| Total Workload | Estimated workload for all cases | totalWorkload | N/A |
| Daily Average Cases | Team's average daily case processing | dailyProcessedNum | Past N days completed cases / working days |
| Daily Average Workload | Team's average daily workload | dailyProcessedWorkload | Past N days completed workload / working days |
| Backlog Cases | Number of pending/unstarted cases | backloggedNum | totalNum - completedNum |
| Backlog Rate | Percentage of backlog cases | backloggedRate | (backloggedNum / totalNum) × 100% |
| Backlog Workload | Estimated workload for backlog cases | backloggedWorkload | totalWorkload - completedWorkload |
| Workload Backlog Rate | Percentage of backlog workload | backloggedWorkloadRate | (backloggedWorkload / totalWorkload) × 100% |
| Estimated Completion Time (hours) | Time to clear backlog | backloggedCompletionTime | backloggedWorkload / dailyProcessedWorkload |
Recent Delivery Metrics
💡 Evaluate project delivery efficiency
| Metric | Description | Parameter Name | Calculation Formula |
|---|---|---|---|
| Total Cases | Total number of test cases | totalNum | N/A |
| Delivered Cases | Number of delivered cases | completedNum | N/A |
| Delivery Rate | Percentage of delivered cases | completedRate | (completedNum / totalNum) × 100% |
| Total Workload | Estimated total workload | totalWorkload | N/A |
| Delivered Workload | Actual workload for delivered cases | completedWorkload | N/A |
| Delivered Workload Rate | Percentage of delivered workload | completedWorkloadRate | (completedWorkload / totalWorkload) × 100% |
| Total Saved Workload | Difference between estimated and actual | savingWorkload | Estimated workload - delivered workload |
| Saved Workload Rate | Percentage of saved workload | savingWorkloadRate | (savingWorkload / totalWorkload) × 100% |
| Total Overdue Cases | Number of overdue cases | totalOverdueNum | N/A |
| Delivered Overdue Cases | Number of delivered but overdue cases | overdueNum | N/A |
| Delivered Overdue Rate | Percentage of overdue delivered cases | overdueRate | (overdueNum / completedNum) × 100% |
| Delivered Overdue Workload | Workload of overdue delivered cases | overdueWorkload | N/A |
| Delivered Overdue Workload Rate | Percentage of overdue workload | overdueWorkloadRate | (overdueWorkload / completedWorkload) × 100% |
Delivery Cycle Metrics
💡 Analyze case processing efficiency
| Metric | Description | Parameter Name | Calculation Formula |
|---|---|---|---|
| Total Processing Time | Total time spent on completed cases | totalProcessingTime | Sum of all case processing times |
| Average Per-person Time | Team member's average processing time | userAvgProcessingTime | totalProcessingTime / team size |
| Average Processing Time | Average time per case | avgProcessingTime | totalProcessingTime / completedNum |
| Minimum Time | Fastest case completion time | minProcessingTime | N/A |
| Maximum Time | Slowest case completion time | maxProcessingTime | N/A |
| P50 (Median) | Time by which 50% cases are completed | p50ProcessingTime | Median of sorted processing times |
| P75 | Time by which 75% cases are completed | p75ProcessingTime | 75th percentile of sorted times |
| P90 | Time by which 90% cases are completed | p90ProcessingTime | 90th percentile of sorted times |
| P95 | Time by which 95% cases are completed | p95ProcessingTime | 95th percentile of sorted times |
| P99 | Time by which 99% cases are completed | p99ProcessingTime | 99th percentile of sorted times |
Unplanned Work Metrics
💡 Monitor impact of unexpected work on projects
(Note: The original Chinese content didn't include specific metrics for this section, so the heading is translated without detailed metrics)| Metric | Description | Parameter Name | Calculation Formula | |-------------------------|------------------------------------------|--------------------------------|----------------------------------------------| | Total Test Cases | Number of all test cases in the project | totalNum | N/A | | Total Workload | Estimated total workload for all cases | totalWorkload | N/A | | Unplanned Cases | Number of cases not in original plan | unplannedNum | N/A | | Unplanned Case Ratio | Proportion of unplanned cases | unplannedRate | (Unplanned Cases / Total Cases) × 100% | | Completed Unplanned Cases | Number of completed unplanned cases | unplannedCompletedNum | N/A | | Unplanned Completion Rate | Completion rate of unplanned cases | unplannedCompletedRate | (Completed Unplanned / Unplanned Cases) × 100% | | Unplanned Workload | Estimated workload for unplanned cases | unplannedWorkload | N/A | | Unplanned Workload Ratio | Proportion of unplanned workload | unplannedWorkloadRate | (Unplanned Workload / Total Workload) × 100% | | Completed Unplanned Workload | Actual completed workload for unplanned cases | unplannedWorkloadCompleted | N/A | | Completed Unplanned Workload Ratio | Completion ratio of unplanned workload | unplannedWorkloadCompletedRate | (Completed Unplanned Workload / Unplanned Workload) × 100% | | Estimated Processing Time for Unplanned Cases | Estimated time to complete unplanned work | unplannedWorkloadProcessingTime | Unplanned Workload / Team Daily Average Workload |
Test Case Growth Trend
💡 Monitor project scale evolution and workload distribution.
| Metric | Description | Parameter Name | Calculation Formula |
|---|---|---|---|
| Total Test Cases | Number of all test cases in project | totalNum | N/A |
Usage Principles
- Guide Improvement: Metrics should optimize processes, not solely for performance evaluation
- Quality Balance: Avoid sacrificing test quality to improve quantitative metrics
- Project Adaptation: Interpret data considering project characteristics
- Correlation Analysis: Focus on relationships between metrics (e.g., backlog rate vs. delivery overdue rate)
- Transparency Culture: Encourage honest data reporting and open communication
Through scientific analysis of these metrics, testing teams can precisely identify efficiency bottlenecks, optimize resource allocation, and continuously improve software quality and delivery efficiency.