Author: Ivan Lisitsyn

How to analyze a load test report? Part 3: Errors.
Testing practice WAPT usage

How to analyze a load test report? Part 3: Errors.

If you see any errors after executing a load test, first of all you should check if this is a test design problem. I wrote about the most typical problems of that kind here.

Now let’s suppose that the test was designed correctly and any errors we see in the report are related to the load you created in the test. In other words, I would like to talk about errors that appear because of performance problems, not anything else. If you are not sure why an error takes place, try running the test with same profiles and a smaller number of users, and see if the same problem appears.

First of all I should note that there are different types of errors.

WAPT Cloud: New benefits of our load testing solution
General Testing practice WAPT usage

WAPT Cloud: New benefits of our load testing solution

In the last days of 2013 we released a cloud version of our load testing solution. It is based on WAPT Pro, all extension modules and x64 Load Engines, so it is the most feature-reach and powerful combination of all the components we have.

This on-demand load testing solution is offered through the Amazon EC2 Marketplace. This means that with few clicks you can get the full functionality of WAPT Pro running on a virtual system instance in the Amazon Cloud. To do this you need to have an AWS account, however it is also very easy to create one. We provide step by step usage instructions right from our web site.

Some experienced users already know that all our products can be used in any cloud or virtual environment. So, technically this release is not a big step forward. With new cloud version it is easier to start and configure the product, but this is not the actual benefit. What really makes the change is the pricing for the new solution, which is now based on the hour rates.

How to setup SNMP monitoring of a Windows system
General

How to setup SNMP monitoring of a Windows system

SNMP (Simple Network Management Protocol) is a network protocol that allows one device to query another device for information, change information on a device, or for one device to send a message to another device. It is widely used to monitor hardware and software components of web sites during normal operations or during testing. That is why advanced load testing tools, such as WAPT Pro, usually have ability to connect to any servers and receive performance counters data (such as CPU or RAM usage values).

Older versions of Windows, like XP, had SNMP service installed by default, so you only had to start it or enable automatic start. After that you could connect to that system with any SNMP client and monitor anything you needed.

How to setup Oracle monitoring in WAPT Pro
WAPT usage

How to setup Oracle monitoring in WAPT Pro

WAPT Pro can monitor the performance of database servers during the test. This is useful in case your web application uses a database running on a separate server and you want to check if that database can be a performance bottleneck.

Each database has a special table with performance parameters (such as the number of transactions completed per second, number of threads, etc.). To retrieve any specific parameter you need to execute the corresponding SQL statement. So, this is done the same way as any other data retrieval. The only difference is that performance parameters are calculated by the database server itself. You do not need to create the performance table before using data from it.

How to analyze a load test report? Part 2: Test design problems.
Testing practice WAPT usage

How to analyze a load test report? Part 2: Test design problems.

When you start load testing a web site (especially if this is the first load test in your life) you may see a lot of errors in the report. Possibly you will even have to stop the test before it completes, because at some point in time it becomes clear that something goes wrong. If the problem is not so obvious, it is still recommended to check the report for the errors related to each virtual user profile (i.e. to each different type of virtual users) before looking at any performance data.

Usually you do not create a high load in the very first test of a web site, so if you see any errors in the report, most probably they appear because of the test design problems. In other words, the emulation of the real user activity is performed incorrectly. Your web application may produce errors and even refuse connections because it receives incorrect data from your load testing tool. Why this may happen?