Load Testing Objectives

Load test plan should be based on clearly defined testing objectives like:

  • Determine if the application complies with contracts, regulations, and service level agreements (SLAs).
  • Detect bottlenecks to be tuned.
  • Assist the development team in determining the performance characteristics for various configuration options.
  • Provide input data for scalability and capacity-planning efforts.

The following table reflects the common application testing objectives that a performance test tool, LOAD TEST helps in load test.

Objectives

Definition

Measuring end-user response time

To measure the duration of completing a business process

Defining optimal hardware configuration

To define the hardware configuration that provides the best performance

Checking reliability

To ensure how hard/long can the system work without the occurrence of errors/failures.

Checking hardware or software upgrades

To check whether and how the upgrade effects performance or reliability

Evaluating new products

To identify the server hardware or software to be chosen

Measuring system capacity

To measure the load the system can handle without significant performance degradation

Identifying bottlenecks

To identify those elements which slows down the response time

Table 1: Common Application Testing Objectives

Measuring End-User Response Time

To check how much time a user takes to perform a business process and receive a response from the server. For example, if user wants to verify that while the system operates under normal load conditions, the end users receive responses to all requests within 20 seconds or not.

Defining Optimal Hardware Configuration

To check how the web performance is affected by various system configurations, such as memory, CPU speed, cache, adaptors, and modems. Once user recognizes the system architecture and checks the application response time, he/she can measure the application response for different system configurations to find out which settings can achieve the desired performance levels. For example, the user set up three different server configurations and run the same tests on each configuration to determine performance variations.

Checking Reliability

To identify how much the system is stable if heavy or continuous workloads are applied. User can use Performance Test Tool say LOAD TEST to create stress on the system. User can force the system to handle extended activity in a compressed time period to simulate the kind of activity a system normally experiences over a period of time.

Checking Hardware or Software Upgrades

User can perform regression testing for comparing a new release of hardware/software to an older one. User can check how a software/hardware upgrade affects response time and reliability. Application regression testing does not check new features of an upgrade. It only compares the efficiency and reliability of the new release with the older one.

Evaluating New Products

User can evaluate individual products and subsystems during the planning and design stage of a product’s life cycle by running tests. For example, the user can identify which hardware for the server machine or the database package based on evaluation tests.

Measuring System Capacity

To measure system capacity and find out the excess capacity the system can handle without performance humiliation. For checking the system capacity, user can compare performance with load onthe existing system and identify from where significant response-time degradation begins to occur.

Identifying Bottlenecks

User configures the Performance Test Tool, say LOAD TEST monitoring components to determine bottlenecks on the system and identify the elements which are causing performance degradation. For example, file locking, resource contention, and network overload. Use LOAD TEST in conjunction with the new network and machine monitoring tools to create load and measure performance at different points in the system.

Plan a Load Test

This section describes the key points on how to plan a load test.

  • Analyze the application thoroughly.
  • List down and define the load testing objectives.
  • Plan the implementation of Performance Test Tool say LOAD TEST.

Analyze the Application/System

This section describes the key things on how to go ahead to analyze the application under test as a part of load test planning.

  • Identify the application/system components.
  • Describe the application/system configuration.
  • Define the system/application usage.
  • Analyze the workflow and task distribution.

Define the Load Test Objectives

This section describes the key points. Based on those, user can define the objectives of load tests.

  • Finalize the general objectives.
  • State the objectives in a measurable term.
  • Decision on when to test.

Plan the LOAD TEST Implementation

This section describes the key points, which describes how and why to plan the implementation of LOAD TEST.

  • Define the scope of performance measurements.
  • Define the virtual user activities.
  • Select virtual user.
  • Choosing testing hardware/software.

Run – Load Test Scenario

Running Scenarios Overview

And the Load Test Plan helps the user in performing Load Testing in the manner to:

  • Start of Run: When the user instructs LOAD TEST to begin the scenario run, the Controller checks the scenario configuration information, invokes the applications that were selected to run with the scenario, and then distributes each Vuser script to its designated load generator. When the Vusers are ready, they start running their scripts. As the scenario starts, in the Scenario Groups panel, user can watch Vusers gradually start running.
  • During Run: During the scenario run, user can see a synopsis of the running scenario in the Scenario Status panel. User can also drill down to see which Vuser actions are causing the application problems. The Dashboard UI’s online graphs display performance data collected by the monitors. User can use this information to isolate potential problem areas in the system.
  • End of Run: The scenario ends when all the Vusers have completed their scripts, when the duration runs out, or when it is terminated. After the test run, the Scenario Status panel displays the Down status. This indicates that the Vusers have stopped running.

To Run a Scenario

This task describes how to run a scenario.

  1. Open an existing scenario or create a new one.
  2. Prepare to run the scenario. Before running a scenario, provide details for the scenario and the other run-time related configurable settings.
  3. To run the scenario, click the Start button  corresponding to a scenario.
  4. Once it is clicked, a new window, Start Scenario displays where user has to provide the Test Name and click the Start Scenario
Figure 41: Start Scenario

Note: While starting the test from scenario, the test name should start with an Alphabet. Allowed characters are: alpha, numeric, hyphen, full stop, underscore, and angular bracket. If the user tries to enter other special characters except these, an error message is displayed.

Run/Stop Scenario

This section describes the key points on how to plan a load test.

  • Analyze the application thoroughly.
  • List down and define the load testing objectives.
  • Plan the implementation of LOAD TEST.

Starting a Test

1. For starting a test, when the user clicks the button, provides the test name, and clicks the Start Scenario button, the user is prompted to provide the activation key.

Figure 42: Authentication Domain

2. On matching the activation key, the test gets started and Test Initialization window is displayed.

Figure 43: Test Initialization Window