Difference between revisions of "Epsilon/Stable Version QA"

Revision as of 12:47, 4 October 2012

Unlike interim releases, which are only required to pass their unit tests, stable releases should be manually tested on top of a clean copy of the latest stable Modelling distribution (Juno, at the time of this writing). Epsilon should be tested in the same way over the three target platforms: Windows, Mac OS X, and GNU/Linux. Since it's pretty much pure Java, the actual architecture (whether 32-bit or 64-bit) should not matter.

There are several questions that our manual testing should answer. We will describe how we can test for those below.

Can the features be installed?

Properly defined features declare all their dependencies, so we should be able to install each of them separately on top of a clean install. Eclipse should be able to automatically pick up other Epsilon features from the one we have selected.

If we have features A, B (depending on A) and C (depending on A) we should test that:

1. Feature A can be installed from a clean install.
2. By selecting feature B from a clean install, feature A will be picked up and install successfully as well.
3. Same for feature C.

We might need to document additional dependencies for specific features. Some of these dependencies may have to be picked from external sources. We should provide the user with a suitable default choice.

Are the feature descriptions accurate, and do they work?

We need to ensure that each feature provides the expected functionality and no less. To do that, we can use the examples bundled with Epsilon: this will also serve as testing the documentation included with the release.

Here is a selection of examples, with the features they should be tested with and the actions to be performed with them:

• emc.dummydriver: core. Does not require GMF tooling. Should only require running the DummyModel class as a standalone Java application.
• eugenia.examples.fed: eugenia (generation from .ecore + execution).
• eugenia.examples.friends: Emfatic, eugenia (generation from .emf + execution, to launch its EGL script).
• eugenia.examples.filesystem: eugenia, evl.emf (generation + validation from GMF).
• eugenia.examples.flowchart: eugenia, ewl.gmf (generation + execution, to check the custom figures and try the EWL wizard).
• eunit.examples.*: emf.dt. running the Ant tasks should cover the workflow and the E*L engine as well. (NB: some of these examples require hutn)
• buildooinstance: core and emf to run, core.dt to edit the .eol files.
• evl.ecore: evl.emf.
• ewl.ecore: ewl.emf.
• hutn.families: hutn to run the example, hutn.dt to provide the editors (to be installed later).

We still need an example to test the Concordance feature, though.

Note: as of 1.0RC2 (2012-09-30), the Eugenia feature requires installing the GMF Tooling separately. It's not picked up from the feature dependencies.