Skip to main content
Jump to: navigation, search

Difference between revisions of "RAP/RWT Cluster"

< RAP
(Test Infrastructure)
(How to run RWT in a cluster)
Line 81: Line 81:
 
The tests reside the [http://eclipse.org/rap/source source code repository] under <code>org.eclipse.rap.rwt.cluster.test</code> and the fixture can be found in <code>org.eclipse.rap.rwt.cluster.testfixture</code>. Tests for the fixture in turn are in <code>org.eclipse.rap.rwt.cluster.testfixture.test</code>.
 
The tests reside the [http://eclipse.org/rap/source source code repository] under <code>org.eclipse.rap.rwt.cluster.test</code> and the fixture can be found in <code>org.eclipse.rap.rwt.cluster.testfixture</code>. Tests for the fixture in turn are in <code>org.eclipse.rap.rwt.cluster.testfixture.test</code>.
  
== How to run RWT in a cluster ==
+
== How to setup RWT in a cluster ==
 
Setup a cluster with the servlet engine of choice. There are short tutorials that help to set up a cluster with [[Jetty/Feature/Session_Clustering_Using_a_Database|Jetty]] or [http://tomcat.apache.org/tomcat-7.0-doc/cluster-howto.html Tomcat].
 
Setup a cluster with the servlet engine of choice. There are short tutorials that help to set up a cluster with [[Jetty/Feature/Session_Clustering_Using_a_Database|Jetty]] or [http://tomcat.apache.org/tomcat-7.0-doc/cluster-howto.html Tomcat].
  

Revision as of 05:50, 23 September 2011

| RAP wiki home | RAP project home |

Warning2.png
Support for Transparent Session Failover in RWT is not entirely in its final shape and some details outlined below may change


Introduction

Load balancing to distribute workload across multiple nodes in a cluster works with RAP out of the box since version 1.0. One thing to mind though when setting up a load balancer for RAP applications is that it must be configured to use sticky sessoins (aka session affinity). This entails that once a session is started, the same server serves all subsequent requests for that session. For information on how to set up load balancing, refer to the servlet container documentation. E.g. Tomcat

If your application provides critical servies you may want to make it fail safe by running it in a high high-availability cluster. A high availability cluster operates by having redundant nodes. So that if one node crashes, the service as a whole is unafected as other nodes take over the work.

Throughout this document, the term cluster refers to high-availablility clusters.

With version 1.5 M1, RAP can be configured for transparent session failover so that applications can run in a high-availability cluster. This means that two or more servlet engines form a cluster, where a session, and its contents, can be moved from one node of the cluster to another node.

In §7.7.2 (Distributed Environments), the servlet specification requests for distributable aplications that all session data must implement the Serializable interface. This results in two main abstacles to overcome with the current implementation:

  • All RWT objects that live in the session scope (i.e. are directly or indirectly stored in a session attribute) must be serializable. This will mainly affect Display, Widget and derived classes and Resource and derived classes.
  • The RWTLifeCycle which creates a UI Thread that lives until the session is terminated. The UI thread is necessary to enable blocking dialogs and so ensures compatibility with SWT. The downside of the UI thread of course is that sessions (which hold a reference to the UI thread) cannot be migrated as - naturally - a thread cannot be serialized.

Serializable RWT sessions can also be used to swap inactive sessions onto disk and thereby releasing the memory consumed by them. This allows for long to infinite session timeout settings that result in user friendly web applications that don't bother users with 'session has expried' messages and on the other hand don't consure more memory than actually needed. This feature is e.g. supported by Tomcat

State of Development

The core features that enable RWT and JFace to run in a high-availability cluster are implemented. bug 341761 is used as a meta-bug to capture the problem and track the solution. Please see this bug for details on what is left to do.

Alternative Life Cycle

An alternative life cycle implementation is availiable that does not use an extra thread. As a consequence thereof blocking dialogs aren't possible with this life cycle. The new life cycle also makes it easier to access security or transaction contexts and is conform to the JEE Specification. Even if you don't have a need for high availability clustering, if you don’t use blocking dialogs or workbench features we recommend to use this life cycle.

For application code to still be able to use dialogs we introduced the DialogUtil helper class. It allows to open dialogs in a non-blocking way and informs you via the supplied DialogCallback when the dialog was closed.

MessageBox messageBox = new MessageBox( parent, SWT.YES | SWT.NO );
messageBox.setMessage( "Are you OK?" );
DialogUtil.open( messageBox, new DialogCallback() {
  public void dialogClosed( int returnCode ) {
    if( returnCode == SWT.YES ) {
      // ...
    } 
  }
} );

Please consult the JavaDoc for further details.

UICallback#activate() and #deactivate() are not affected by this life cycle. They continue to work as with the UI-threaded life cycle. However, UICallback#activate() is usually used to propagate changes from background threads to the UI. We need to investigate if it is feasible to use background threads (with certain constraints) in a high availability environment.

Serializable Session Data

The core classes with session scope are serializable. This includes Device and Display, all widgets, layouts and layout data, Dialog and its subclasses, Accessible and its associated classes, drag & drop classes, resources, data structures (e.g.Point, Rectangle, etc.), listeners and their respective events, ISessionStoreListener.

If a session attribute changes, the servlet engine must be told to replicate the change. Unfortunately the Servlet specs do not specify how this should be done. The most common way is to call HttpSession.setAttribute() to flag the object as changed (see J2EE clustering, Part 2, section Session-storage guidelines). In RWT, after each request the session attribute that holds the ISessionStore is re-set into the session. This means that as long as application code stores data in an attribute of the ISessionStore or with the help of SessionSingletonBase, all changes will be replicated.

Each serializable class has a version associated, which is used during deserialization to ensure that the loaded class is compatible with the serialized object with respect to serialization. A class can state the version of its serialized form explicitly by declaring a field named serialVersionUID that holds the verion number. If a class does not explicitly declare a serialVersionUID, then a version will be calculated at runtime. Even though it is strongly recommended to explicitly declare the serialVersionUID, we decided against for these reasons (bug 351641):

  • The serialized form is stored for a short time only. Currently, it is hardly imaginable that in between serialization and deserialization, a new application is deployed (and with it the version of the serialized form changes)
  • Maintaining an explicit serialVersionUID is hard. With each field that is added or removed from a serializable class, it must be considered whether the serial version is affected. Thre is no (automated) quality assurance established to ensure this and installing one would be a considerable amount of work.
  • The clutter of serialVersionUID declarations reduces the readability of the source code.

If the future shows that explicit serialVersionUID become necessary, they can still be added.

Display#(a)syncExec()

Display#(a)syncExec() can be used to propagate UI changes from background threads. The passed on runnable is stored in a queue of the Display and executed when the event loop is running for the next time.

In a cluster environment, this has several implications. Passing a runnable to (a)syncExec() effectively alters the session. But as this happens outside of a request, the (clustered) servlet engine has no chance to replicate the changed session.

The ClusterSynchronizer is provided to replicate changes to the queue of async runnables of a display. Each Synchronizer is notified whenever a runnable is added by calling either asyncExec() or syncExec(). The ClusterSynchronizer sends an empty request to itself that in turn gives the servlet engine the opportunity to replicate the session.

A further problem and one that cannot be solved by RWT is the background thread itself. Threads - naturally - aren't serializable and thus cannot be replicated among cluster nodes. This means that the application is responsible to implement the background thread in a fail-safe way.

Known Issues

  • Images that were created with one of the Graphics#getImage() methods (curently) cannot be serialized (bug 357769).
  • The graphics context (GC) is not meant to be serialized because it should only be used within the scope of a request. I.e. it is created and ddestroyed within the paintControl() method of a PaintListener.
  • As a consequence of the threadless life cycle, Display#sleep() cannot be implemented and throws an UnsupportedOperationException.
  • Because of the missing Display#sleep(), Browser#execute() and evaluate() will not work either. These methods call sleep() to wait for the result of the Javascript execution.
  • Attempts to call Windows#open() when setBlockOnOpen() was set to true will not work. Open() uses Display#sleep() to block execution flow.
  • A further consequence of the missing Display#sleep() is of course that entry points must not contain the usual event loop (see below for an example).

Yet to be done

  • JFace components cannot yet be used in session-failover environments (bug 352926)
  • Running a clustered RWT application in OSGi isn't yet possible (bug 353117)

Test Infrastructure

To be able to run tests from JUnit, there are helper classes with which an arbitrary number of embedded serlvet engines can be created. Either standalone or clustered. Currently the tests can be run with Jetty 7.4 and Tomcat 7.

The tests reside the source code repository under org.eclipse.rap.rwt.cluster.test and the fixture can be found in org.eclipse.rap.rwt.cluster.testfixture. Tests for the fixture in turn are in org.eclipse.rap.rwt.cluster.testfixture.test.

How to setup RWT in a cluster

Setup a cluster with the servlet engine of choice. There are short tutorials that help to set up a cluster with Jetty or Tomcat.

In order to run an RWT application in a cluster-enabled servlet engine, an additional servlet filter must be registered. The web.xml should look like the one below:

<web-app xmlns="http://java.sun.com/xml/ns/javaee" 
  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  xsi:schemaLocation="http://java.sun.com/xml/ns/javaee http://java.sun.com/xml/ns/javaee/web-app_2_5.xsd"
  version="2.5">
 
  <context-param>
    <param-name>org.eclipse.rwt.Configurator</param-name>
    <param-value>com.example.ExampleConfigurator</param-value>
  </context-param>
 
  <listener>
    <listener-class>org.eclipse.rwt.internal.engine.RWTServletContextListener</listener-class>
  </listener>
 
  <filter>
    <filter-name>rwtClusterSupport</filter-name>
    <filter-class>org.eclipse.rwt.internal.engine.RWTClusterSupport</filter-class>
  </filter>
  <filter-mapping>
    <filter-name>rwtClusterSupport</filter-name>
    <servlet-name>rwtDelegate</servlet-name>
  </filter-mapping>
 
  <servlet>
    <servlet-name>rwtDelegate</servlet-name>
    <servlet-class>org.eclipse.rwt.internal.engine.RWTDelegate</servlet-class>
  </servlet>
  <servlet-mapping>
    <servlet-name>rwtDelegate</servlet-name>
    <url-pattern>/</url-pattern>
  </servlet-mapping>
 
</web-app>

The class specified in the org.eclipse.rwt.Configurator parameter must implement the org.eclipse.rwt.engine.Configurator interface. Its configure() method is called just before the application starts. It should be used to add the entry point(s) that are available to the application and configure other aspects of the application. To work in a cluster environment, the Configurator implementation must at least choose the threadless life cycle. The ExampleConfigurator should look like this:

public class ExampleConfigurator implements Configurator {
  public void configure( Context context ) {
    // select the threadless life cycle
    context.setLifeCycleMode( Context.LifeCycleMode.THREADLESS ); 
    context.addEntryPoint( EntryPointManager.DEFAULT, ExampleEntryPoint.class );
  }
}

As the cluster-enabled life cycle does not support Display#sleep(), the event loop must be removed from the entry point. The ExampleEntryPoint should look like the one below.

public class ExampleEntryPoint implements IEntryPoint {
  public int createUI() {
    Display display = new Display();
    Shell shell = new Shell( display );
    shell.setText( "Hello World" );
    // create more widgets...
    shell.open();
    // omit the event loop
    return 0;
  }
}

If the application is going to use Display#(a)syncExec() to propagate UI changes from background threads, an appropriate Synchronizer must be attached to the Display.

Display display = new Display();
display.setSynchronizer( new ClusteredSynchronizer( display ) );

When deploying the application in the cluster, it must be ensured that each node receives the exact same version of the application.

Performance Comparison

To get an idea what the performance impact of clustering a web application means, we did a basic load tests.

A simple web application that consists of a shell and several buttons was used. This application was deployed to a Tomcat 7.0 and a Jetty 7.4 servlet engine. Each once configured as a single engine and once clustered.

With the help of JMeter, a web session was recorded in which several of the buttons were selected. The entire recording consists of 24 requests. This session was then played back, simulating 500 concurrent users with a ramp up period of 60 Seconds that use the web application.

Even though the performance impact is significant, the response times are sufficiently fast for Ajax-driven web applications Manual sessions that were opened while the load tests were running, also proved that. The table below shows the response times for each of the scenarios in Milliseconds.

Average Median 90% Line
Jetty single 4.8 ms 1 ms 4 ms
Jetty cluster 13.3 ms 6 ms 29 ms
Tomcat single 1.5 ms 1 ms 2 ms
Tomcat cluster 3.1 ms 2 ms 6 ms


Performance comparison between single and clustered servlet engines

Development Snapshots

Development takes place in HEAD, if you are interested you may want to directly check out from the source code repository. Nightly builds are also available and can be obtained from the downloads page.

If you whish to run the cluster tests, you will have to add the Jetty 7.4, the H2 database (version 1.1) and the Servlet API (version 3.0) to your target platform. The Eclipse Orbit project offers bundled versions of H2 (org.h2) and the Servlet API (javax.servlet). In addition Tomcat 7.0.12 is needed, please use the pre-bundled version from the RAP source code repository at /cvsroot/rt/org.eclipse.rap/runtime.rwt.test.

Please note that these tests (like all other RWT tests) are neither part of nightly builds nor milestone builds.

Back to the top