Difference between revisions of "RAP/LoadTesting"

Latest revision as of 07:57, 28 February 2014

This article describes load testing / stress testing of RAP applications with Apache JMeter. JMeter lets you record all HTTP(S) requests of a browser session and replay these requests in multiple parallel sessions.

This Introduction (PDF) is very useful for getting started with JMeter.

Prepare a Test Plan

• Download a recent version of JMeter and start it.

There are two elements in the tree, called Test Plan and WorkBench. Let's start with creating the Test Plan.

Add a Thread Group

The Thread Group will contain your recorded requests.

• Select Add > Threads (Users) > Thread Group from the context menu.
• Configure at least these settings:
  • Number of Threads (users): this is the number of sessions that will in run in parallel
  • Ramp-up Period (in second): the time it takes until the last session is started

Add HTTP Request Defaults

• Add > Config Element > HTTP Request Data
• Configure at least these settings:
  • Server Name or IP: the host name or IP address of the server you run the tests against.
  • Path: the base path of your application.

Add a Recording Controller

The recording controller will contain the recorded requests

• Add > Logic Controller > Recording Controller

Add a Cookie Manager

The cookie manager is required to ensure the same HTTP session in each request. If cookies are not working every request will create a new HTTP session and the server will return an HTTP error code.

• Add > Config Element > HTTP Cookie Manager

The defaults are fine.

Please note that there is a bug in JMeter 2.3.1 for clearing cookies for multiple runs / iterations; please use either JMeter 2.3.2 or later see [1]).

Add a Timer

In order to configure the request interval, you have to add a timer. Without a timer, every response is immediately followed by the next request, something a real user is not able to do.

You might want to use a random timer to add some deviation to the interval. This will lead to a better approximation of a real users behavior. We recommend the Gaussian random timer.

• Add > Timer > Gaussian Random Timer
• Configure:
  • Constant Delay Offset (in milliseconds): the time between two requests
  • Deviation (in milliseconds): the deviation of this interval

Prepare the Recording

Add Test Script Recorder

JMeter contains a test script recorder. This is basically a proxy server that listens on a local port (8080 by default). Since the recorder is not part of the test plan, it is added to the Workbench node.

• Open the context menu on WorkBench, and select Add > Non-Test Elements > HTTP(S) Test Script Recorder (in older versions this was called HTTP Proxy Server).
• Things to configure:
  • Global Settings > Port: the port that the proxy server should listen to.
  • URL Patterns to exclude: to exclude static resources served by RAP, use the exclude pattern .*\/rwt-resources\/.*

Whether or not to exclude requests for static resources (images, script files, etc.) is up to you. These resources are cached by the browser and only contribute a small portion to the entire server load. However, you can safely keep static resources in the recording if you prefer.

Configure Browser

• Configure your browser to use a proxy. Use localhost and the port you configured in the test recorder (8080 by default).

Record a test

• Press the Start button at the bottom of the HTTP(S) Test Script Recorder page to start the recorder.
• Open a new browser tab and load the URL of your application.
• Now click through the application to record the test session.

• Note: In RAP versions prior to 2.1, you had to re-start the browser before recording a test in order to ensure the parameter requestCounter started from zero.

Remove ServerPush Requests

After recording your test, you need to eliminate all requests with parameter servicehandler = org.eclipse.rap.serverpush. Usually, these are all requests without a cid parameter in the URL.

These requests are not answered by the server and will lead to blocking.

Save Test Plan

At this point, you should save the recorded test plan to a file.

Running a test

Once the test plan is configured and session is recorded, you can start the test by pressing the green Start button in the toolbar.

In the top right corner, you can observe the number of parallel sessions that are currently running.

Checking the Results

To ensure that your recording is OK, you may want to start the test with only ONE session (configured in the Thread Group).

Save Responses to Files

By adding this element to your test plan you can ensure that the responses contain real JSON (not just errors). The first response will be HTML, all other responses JSON.

Add > Listener > Safe Responses to a File

Note that the target directory has to be present, it will not be created by JMeter.

If you run the recording twice, the second pass should lead to the same pattern of responses as the first one.

Configuration and Tuning Tips

• Run JMeter and the server on different machines. JMeter causes significant CPU load as well.

• Provide your application with enough heap. This depends on the number of active sessions and the memory consumption per session of your application.

• Choose an appropriate garbage collection strategy. We've found -XX:+UseConcMarkSweepGC to work best (on multi-core machines). The default garbage collector may lead to longer GC periods and can delay some responses drastically.

• Start the JVM in server mode (-server)

• If you use Tomcat, this servlet http://yourserver/manager/status/all provides interesting information

• When running JMeter with many worker threads, you must increase its heap size. It is advisable to start with a large initial heap size, to avoid delays resulting from additional heap allocation. Refer to the HEAP parameter in the jmeter script.

Running JMeter in headless mode

Running JMeter with a GUI could slow it down. You can run JMeter in headless mode, using the command below. This runs testplan.jmx and saves the results to result.jtl.

./jmeter -n -t /home/elias/testplan.jmx -l /tmp/result.jtl

The result file can be opened with jmeter after the test run is finished. A large result file takes some time and memory to open - be patient and increase the heap. Warning: interrupting a test run in progress, will create an incomplete result file that cannot be opened! Note also that the command will immediately return and then jmeter will be executing in the background (as a separate javaw process). Wait for this to finish before opening the results file.

URL rewriting instead of cookies

We don't recommend using URL rewriting. However, if you rely on it, this forum post might help:

I was able to run the test with the url rewriting. In JMeter there is something called regular expression extracter. I used this to extract the jsessionid from the first response from the server and then pass the same id in the all the other requests.