A modern performance test tool must provide excellent solutions to a number of requirements to be a cost-effective and productive investment.
The following topics describe a selection of challenges for performance test tools and our solutions with MBC.
Test tool productivity solutions
With productivity solutions we mean a test tool's capability of working efficiently and thus produce more test results.
An example of more test results can be less time needed to execute a test case, which enables more tests executed per time period.
Another examples is better quality on measurement results. A third example can be less or no time needed for manual actions.
Test automation solutions
Contrary to function tests that can be done manually or automated, performance test are always automated.
With solutions for test automation of performance tests we mean that test tools shall not only run a performance test, but do it at any time without manual intervention.
This shall also include automated handling of all actions related to running a performance test case, i.e. all actions shall be scripted in the test case.
Test tool scalability solutions
A test tool's ability to generate load can increase dramatically during development due to customer requirements.
With solutions for performance test tool scalability we mean the capability for the test tool to expand its capacity to any limits with only minor changes.
Test tool flexibility solutions
A test tool's ability easily to create new test cases based on old is important.
With flexibility solutions for performance test tools we mean the capability to reuse or expand test cases for other performance tests.
Complex load scenario solutions
The test tool's ability to generate load can increase dramatically during development due to customer requirements.
With solutions for complex load scenarios we mean the capability for performance test tools to manage complex load with different types of load control.
Extreme load condition solutions
Some performance tests require extreme load patterns to measure the tested system's behaviour.
With solutions for extreme load conditions we mean the capability for performance test tools to generate extreme load patterns.
Complex test scenario solutions
Some performance tests require complex mixes of ueser requests to simulate the tested system's behaviour.
With solutions for complex test scenarios we mean the capability for performance test tools to handle complex service scenarios such as IMS-AKA.
Other cases are complex mixes of service requests reflecting a statistical distribution of of real traffic.