Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "ATL VM Testing"
(→How to contribute) |
(→Processus) |
||
Line 7: | Line 7: | ||
Some relevant EMF-based transformations are integrated to the test set and are launched with the Regular VM and the emfvm. The results of the transformations are comparated using [http://www.eclipse.org/modeling/emft/?project=compare EMF Compare]. When a test pass successfully, execution times are reported for both VMs in order to detect performance issues. | Some relevant EMF-based transformations are integrated to the test set and are launched with the Regular VM and the emfvm. The results of the transformations are comparated using [http://www.eclipse.org/modeling/emft/?project=compare EMF Compare]. When a test pass successfully, execution times are reported for both VMs in order to detect performance issues. | ||
If a test fails, a short description of the problem (or eventually a bug) is reported in the "Comments" field. The test is excluded from the emfvm test set until it is corrected. | If a test fails, a short description of the problem (or eventually a bug) is reported in the "Comments" field. The test is excluded from the emfvm test set until it is corrected. | ||
+ | |||
+ | ==Context== | ||
+ | |||
+ | '''Hardware''' | ||
+ | * Processor : Pentium 2 GHz | ||
+ | * RAM : 2 Go | ||
+ | |||
+ | '''Software''' | ||
+ | * Operating system : Windows XP | ||
+ | * JVM : JRE 1.6 | ||
+ | * Eclipse 3.3 Europa | ||
+ | * ATL 2.0 | ||
==Non-regression table== | ==Non-regression table== |
Revision as of 09:44, 4 December 2007
Intent
This page consists in a report of emfvm non-regression tests. Those tests are available on CVS and reports all performances and regression issues between the two versions of the ATL VM.
Processus
Some relevant EMF-based transformations are integrated to the test set and are launched with the Regular VM and the emfvm. The results of the transformations are comparated using EMF Compare. When a test pass successfully, execution times are reported for both VMs in order to detect performance issues. If a test fails, a short description of the problem (or eventually a bug) is reported in the "Comments" field. The test is excluded from the emfvm test set until it is corrected.
Context
Hardware
* Processor : Pentium 2 GHz * RAM : 2 Go
Software
* Operating system : Windows XP * JVM : JRE 1.6 * Eclipse 3.3 Europa * ATL 2.0
Non-regression table
Test case | Status | Time | Comments | |
---|---|---|---|---|
emfvm | Regular VM | |||
Trace2PerformanceMetrics | PASS | 0.0s. | 0.016s. | |
BibTeX2DocBook | PASS | 0.015s. | 0.047s. | |
FlattenTest | FAIL | 0.016s. | Incomplete collections implementation. | |
XML2Book | PASS | 0.016s. | 0.016s. | |
Families2Persons | PASS | 0.0s. | 0.016s. | |
Ecore2Class | PASS | 0.016s. | 0.015s. | |
DSL2KM3 | PASS | 0.031s. | 0.031s. | |
Book2Publication | PASS | 0.015s. | 0.0s. | |
Class2Relational | PASS | 0.015s. | 0.016s. | |
UML2Relational | FAIL | 0.046s. | Unsupported model elements containing "::". | |
DSL2XML | PASS | 0.11s. | 0.171s. | |
AssertionModification | PASS | 0.078s. | 0.156s. | |
XML2DSLModel | PASS | 1.0s. | 10.703s. | |
XML2Ant | PASS | 0.266s. | 2.094s. | |
DSLModel2KM2 | PASS | 0.015s. | 0.046s. | |
Ant2Maven | PASS | 0.094s. | 0.109s. | |
KM32DSL | PASS | 0.016s. | 0.047s. | |
Maven2XML | PASS | 0.062s. | 0.062s. | |
ATL2Problem | FAIL | 0.094s. | Missing EnumLiteral implementation. | |
XML2DSL | PASS | 0.078s. | 0.485s. | |
SpreadsheetMLSimplified2Trace | FAIL | 0.031s. | Transformation fails without errors. | |
KM32ATL_KM22MM | PASS | 0.015s. | 0.032s. |
How to contribute
To contribute, you can add your own test to the non-regression test. Ensure that : - your work isn't copyrighted - the transformation doesn't uses MDR metamodels (not supported by the emfvm) - the transformation correctly runs on the Regular VM NOTE : At this time, UML2 profiled target models generation isn't supported, but you can submit any concerned tests, in prevision of a future implementation.
To contribute a test, you can either put them into CVS (if you are committer), or contact William Piers.
A non-regression test is never complete, so feel free to contribute your tests !