Test Type Definitions

Clearly define 4 test types to precisely meet different quality verification needs

Four Major Test Types

Test Type	Core Objective	Typical Scenarios	Key Configurations
Functional Testing	Basic function verification	Smoke testing Interface validation	1 concurrency, short execution
Performance Testing	System pressure capacity	Capacity planning Performance optimization	Ramp-up (100↑/min) Max 5000 concurrent
Stability Testing	Long-term operation capability	Production validation Reliability testing	200 concurrent 30 min duration
Custom Testing	Special scenario coverage	Ad-hoc verification Special business flows	Fully customizable parameters

Core Metrics Model

Golden Metrics Definition

Metric	Description	Measurement Dimension
TPS	Transactions per second	System throughput
Response Time	Request processing latency	User experience
Error Rate	Failed request ratio	System stability
Resource Utilization	CPU/Memory consumption	Resource efficiency

Test Model Metrics

Type	Concurrency	Duration	TPS	Response Time	Error Rate
Functional	1	Seconds	-	-	-
Performance	100-5000	50 min	≥500	≤500ms(P90)	≤0.01%
Stability	200	30 min	≥500	≤500ms(P90)	≤0.01%

Advanced Scenario Control

Five Process Controllers

Controller Key Points

1. Transaction Control:

• Must use TRANS_START/TRANS_END in pairs
• Any request failure makes entire transaction fail

2. Wait Time:

• Marked by WAITING_TIME identifier
• Supports fixed/random modes
• Simulates real user operation intervals

3. Rendezvous Point:

• Marked by THROUGHPUT identifier
• Used for burst traffic testing (e.g. flash sales)
• Releases requests simultaneously when enough users gathered

4. Throughput Controller:

• Marked by RENDEZVOUS identifier
• Precisely controls requests per second
• Configurable maximum wait time