Revision as of 14:32, 13 November 2009

Eclipse SDK Test Results as part of eclipse-build

Using the Linux Tools project's eclipse-build output, it is possible to run the SDK JUnit tests with ant [-DbuildArch=<your arch>] runTests.

Requirements for running the tests

• Xvnc (it will default to your main X display if this isn't found at /usr/bin/Xvnc or /usr/X11/bin/Xvnc)
• a functioning eclipse-build
• bash, sed, etc.

Tracking down the root cause of the failure

There are many, many ways that a test could be failing. The first step is to check the test plugin out from CVS (:pserver:anonymous@dev.eclipse.org:/cvsroot/eclipse). Make sure you have the same version checked out as the one that failed (ex. R3_5-1). You'll probably also need to check out org.eclipse.test and org.eclipse.test.performance so get the properly-tagged version of them as well.

You may need to set up an Execution Environment (EE) or two. You can press Ctrl-3 and type execution env and you should see the option to select the Execution Environments preference. Select it and ensure you have proper EEs set up for the bundles you're trying to use. A common trick is to make, say, JavaSE-1.6 prentend to be J2SE-1.4. This isn't the best move from a preventing-coding-errors standpoint, but it will probably do for debugging tests.

Once everything is compiled (you have no errors in your Problems view), try running the tests by right-clicking on the test plugin and selecting Run -> Run As -> JUnit Plug-In Test. If the tests bring up a workbench window, don't touch it in case your doing so affects the outcome of the test run. You should see the JUnit view come up and the results should start filling themselves in. If the error happens here, you can debug it directly. Good luck :) If the tests do not fail when run from your workbench, it will be more difficult to track down the cause of the failure. You can try inspecting the code around the failure location to see if you can spot something that may be sensitive to the location from which it is run. You can set breakpoints and step through the code just like any other plugin.

Running tests from eclipse-build

./runtests.sh is the script that runs the tests. You can modify it to only run one or more sets. It will output the VNC display number it is using. You can connect to this display to watch what's going on with vncviewer :${display number given in output of script}

Test runs where there are failures or errors