Skip to main content

Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

Difference between revisions of "EclipseLink/Development/Testing/Status"

(SDO)
(Platform Results)
 
(159 intermediate revisions by 5 users not shown)
Line 1: Line 1:
 
==Current EclipseLink Test Status==
 
==Current EclipseLink Test Status==
 +
 +
===Nightly Runs===
 +
* [http://www.eclipse.org/eclipselink/downloads/nightly.php Nightly test run results]
 +
* [http://stame02.us.oracle.com/eclipselink/ Nightly test run results (on Oracle)]
  
 
===Foundation===
 
===Foundation===
[[EclipseLink/Test/LRG| Running the legacy LRG]]
+
[[EclipseLink/Development/Testing/foundation| Running the foundation tests]]
  
====MySQL====
+
====Platform Results====
* The SRGTestModel has a small number of failures on MySQL 5
+
Foundation tests are run nightly on Oracle and MySQL.
** At last update 638 of 650 tests pass and there are 17 warnings
+
** There are 3 FatalErrors in the QueryFrameworkTestSuite related to Null not being a valid DB type
+
** There is 1 Error in the UnitOfWorkTestSuite related to a foreign key issue.
+
** Work will be done in the near future to bring the pass rate to 100%
+
* The LRGTestModel runs with moderate success on MySQL 5
+
** At last update, 5088 run, 4869 tests pass, and there are 191 warnings
+
** 16 test models fail to setup
+
** There are 19 Errors
+
** There are 9 FatalErrors
+
** Work will be done in the near future to bring the pass rate to 100%
+
  
====Oracle====
+
Release testing is done on several databases including, Oracle, MySQL, DB2, Sybase, SQL Server, Derby, PostgreSQL.
* The SRGTestModel should pass when run on Oracle 10.2  
+
 
** At last update 659 of 659 SRGTestModel tests pass
+
This table can be used to store results from database or environment runs that are not run nightly.
* The LRGTestModel should pass when run on Oracle 10.2  
+
<table border=1 cellspacing=0 cellpadding=2>
** At last update 6661 of 6741 tests pass (with 80 warnings and 0 failures)
+
<tr style="background:#ffdead">
 +
<td>Label</td> <td>Test</td> <td>Server</td> <td>JDK</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td> <td>Comments</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-12</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>MySQL 5.1.39</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>209</td> <td>0</td> <td>6</td> <td>8591</td> <td>Passed</td> <td></td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-12</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>Oracle 11.1.0.0.0</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>84</td> <td>0</td> <td>0</td> <td>8612</td> <td>Passed</td> <td></td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-12</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>DB2 SQL09010</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>1</td> <td>321</td> <td>0</td> <td>7</td> <td>8564</td> <td>Failed</td> <td>database deadlock in multithreaded test</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-11</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6</td> <td>Derby 10.3.1.4</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>1</td> <td>12</td> <td>321</td> <td>0</td> <td>7</td> <td>8564</td> <td>Failed</td> <td>locking issue, case function not supported, driver null-pointers</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-10</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>Firebird 2.13</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>11</td> <td>18</td> <td>219</td> <td>0</td> <td>7</td> <td>8564</td> <td>Failed</td> <td>some functions not supported</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-05</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>HSQL 1.8.1</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>56</td> <td>0</td> <td>219</td> <td>0</td> <td>8</td> <td>8301</td> <td>Failed</td> <td>outer-joins, query-timeouts</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-10-13+</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>H2 1.2</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>212</td> <td>0</td> <td>10</td> <td>8089</td> <td>Passed</td> <td></td>
 +
</tr>
 +
</table>
  
 
===JPA===
 
===JPA===
[[EclipseLink/Test/JPA| Running the JPA Junit tests]]
+
[[EclipseLink/Test/JPA| Running the JPA LRG]]
  
====MySQL====
+
====Platform Results====
* The FullRegressionSuite has only a few failures when run on MySQL 5
+
JPA tests are run nightly on Oracle and MySQL.
** At last update, 873 tests run. There are 6 errors and 1 failure.
+
** 4 of the errors are related to calling StoredProcedures
+
** 1 of the errors is related to an outer join
+
** 1 of the errors occurs in a sessions.xml test
+
** The failure is a warning related to RAW types on PKs only working on Oracle
+
** Work will be done in the near future to bring the pass rate to 100%
+
  
====Oracle====
+
Release testing is done on several databases including, Oracle, MySQL, DB2, Sybase, SQL Server, Derby, PostgreSQL.
 
+
* The FullRegressionTestSuite passes completely when run on Oracle 10.2
+
** at last update: 874 of 874 tests pass
+
  
 +
This table can be used to store results from database or environment runs that are not run nightly.
 +
<table border=1 cellspacing=0 cellpadding=2>
 +
<tr style="background:#ffdead">
 +
<td>Label</td> <td>Test</td> <td>Server</td> <td>JDK</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td> <td>Comments</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-12</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>PostgreSQL 8.2.5</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-12</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>Oracle 11.1.0.0.0</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-12</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>MySQL 5.1.39</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>2</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-11</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>DB2 SQL09010</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-11</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>Derby 10.3.1.4</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>9</td> <td>2</td> <td>0</td> <td>0</td> <td>1754</td> <td>Failed</td> <td>case function not supported, blob issue, subquerys with multiple columns</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-10</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>H2 1.2</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-05</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>HSQL 1.8.1</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>25</td> <td>6</td> <td>1</td> <td>0</td> <td>0</td> <td>1720</td> <td>Failed</td> <td>outer-joins</td>
 +
</tr>
 +
</table>
  
 
===MOXy===
 
===MOXy===
* The OXM test suite passes completly
+
[[EclipseLink/Development/TestStatus/MOXy-Instructions| Running the MOXy JUnit tests]]
** At last update, 10818 tests run successfully
+
====Platform Results====
* The JAXB test suite passes completly
+
<table border=1 cellspacing=0 cellpadding=2>
** At last update, 323 tests run successfully
+
<tr style="background:#ffdead">
* View the JUnit test summary [[EclipseLink/Development/TestStatus/MOXy-Results| here]]
+
<td>Label</td> <td>Test</td> <td>Server</td> <td>JDK</td> <td>Parser</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td>
*[[EclipseLink/Test/MOXy| Running the MOXy JUnit tests]]
+
</tr>
 +
<tr>
 +
<td>1.1 2008-11-25</td> <td>test-oxm</td> <td>JSE</td> <td>Sun JDK 1.6</td> <td></td> <td>Linux</td> <td>Edwin</td> <td>ant</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>11061</td> <td>Passed</td>
 +
</tr>
 +
<tr>
 +
<td>1.1 2008-11-25</td> <td>test-jaxb</td> <td>JSE</td> <td>Sun JDK 1.6</td> <td></td> <td>Linux</td> <td>Edwin</td> <td>ant</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>400</td> <td>Passed</td>
 +
</tr>
 +
</table>
  
 
===SDO===
 
===SDO===
*The SDO test currently are expected to run with 16 failures and 12 errors.
+
*[[EclipseLink/Development/TestStatus/SDO-Instructions| Building & Running the SDO JUnit tests]]
*At last update, 3807 run, 3795 tests pass
+
====Platform Results====
12 Errors in
+
<table border=1 cellspacing=0 cellpadding=2>
org.eclipse.persistence.testing.sdo.helper.xmlhelper.loadandsave
+
<tr style="background:#ffdead">
*10 - testLoadFromDomSourceWithURIAndOptionsSaveDataObjectToStreamResult
+
<td>Label</td> <td>Test</td> <td>Server</td> <td>JDK</td> <td>Parser</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td>
**Each loadandsave suite will have one of these expected for the myAnyTypeTest root.
+
</tr>
*1 - LoadAndSaveSchemaTypesTestCase:testClassGenerationLoadAndSave
+
<tr>
**Class generation error.
+
<td>1.1 2008-11-25</td> <td>SDO</td> <td>JSE</td> <td>Sun JDK 1.6</td> <td></td> <td>Linux</td> <td>Edwin</td> <td>ant</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>4195</td> <td>Passed</td>
*1 - LoadAndSavePurchaseOrderWithAnnotation:testNoSchemaLoadFromInputStreamSaveDataObjectToString
+
</tr>
**Introduced on 070921 until SDO spec. resolution is received.
+
</table>
 
+
16 Failures
+
*4 in org.eclipse.persistence.testing.sdo.helper.xmlhelper.loadandsave
+
**new failures - verifyAfterLoad assertion.
+
*4 in org.eclipse.persistence.testing.sdo.helper.xsdhelper.defineandgenerate
+
**new failures - XML comparison error.
+
*7 in org.eclipse.persistence.testing.sdo.helper.xsdhelper.generate
+
**older failures involving schema generation comparision failure
+
*1 in org.eclipse.persistence.testing.sdo.model.type
+
**SDOTypeInstanceClassTestCase:testInstanceClassInvlaidNameWithNullInstanceClass
+
**older existing failure.
+
 
+
*1 Known intermittent failure for [[https://bug.us.oracle.com/pls/bug/webbug_print.show?c_rptno=6116651 | bug#6116651]] that tests concurrency issues with open content properties.
+
** in org.eclipse.persistence.testing.helper.helpercontext.SDOHelperContextMultiThreadedTest
+
 
+
 
+
 
+
 
+
 
+
Work will be done in the near future to bring the pass rate to 100%
+
  
 
===DBWS===
 
===DBWS===
 
These tests will be added after we have done some planning for the coordination of the test frameworks
 
These tests will be added after we have done some planning for the coordination of the test frameworks
 +
 +
[[Category:EclipseLink|TestStatus]]

Latest revision as of 17:04, 12 November 2009

Current EclipseLink Test Status

Nightly Runs

Foundation

Running the foundation tests

Platform Results

Foundation tests are run nightly on Oracle and MySQL.

Release testing is done on several databases including, Oracle, MySQL, DB2, Sybase, SQL Server, Derby, PostgreSQL.

This table can be used to store results from database or environment runs that are not run nightly.

Label Test Server JDK Database OS Ran by Runner Errors Fail Warning Setup failures Setup warning Total Success Comments
2.0 2009-11-12 LRGTestModel JSE Sun JDK 1.6.0_07 MySQL 5.1.39 Windows XP James browser 0 0 209 0 6 8591 Passed
2.0 2009-11-12 LRGTestModel JSE Sun JDK 1.6.0_07 Oracle 11.1.0.0.0 Windows XP James browser 0 0 84 0 0 8612 Passed
2.0 2009-11-12 LRGTestModel JSE Sun JDK 1.6.0_07 DB2 SQL09010 Windows XP James browser 0 1 321 0 7 8564 Failed database deadlock in multithreaded test
2.0 2009-11-11 LRGTestModel JSE Sun JDK 1.6 Derby 10.3.1.4 Windows XP James browser 1 12 321 0 7 8564 Failed locking issue, case function not supported, driver null-pointers
2.0 2009-11-10 LRGTestModel JSE Sun JDK 1.6.0_07 Firebird 2.13 Windows XP James browser 11 18 219 0 7 8564 Failed some functions not supported
2.0 2009-11-05 LRGTestModel JSE Sun JDK 1.6.0_07 HSQL 1.8.1 Windows XP James browser 56 0 219 0 8 8301 Failed outer-joins, query-timeouts
2.0 2009-10-13+ LRGTestModel JSE Sun JDK 1.6.0_07 H2 1.2 Windows XP James browser 0 0 212 0 10 8089 Passed

JPA

Running the JPA LRG

Platform Results

JPA tests are run nightly on Oracle and MySQL.

Release testing is done on several databases including, Oracle, MySQL, DB2, Sybase, SQL Server, Derby, PostgreSQL.

This table can be used to store results from database or environment runs that are not run nightly.

Label Test Server JDK Database OS Ran by Runner Errors Fail Warning Setup failures Setup warning Total Success Comments
2.0 2009-11-12 JPA Tests JSE Sun JDK 1.6.0_07 PostgreSQL 8.2.5 Windows XP James browser 0 0 0 0 0 1754 Passed
2.0 2009-11-12 JPA Tests JSE Sun JDK 1.6.0_07 Oracle 11.1.0.0.0 Windows XP James browser 0 0 0 0 0 1754 Passed
2.0 2009-11-12 JPA Tests JSE Sun JDK 1.6.0_07 MySQL 5.1.39 Windows XP James browser 0 0 2 0 0 1754 Passed
2.0 2009-11-11 JPA Tests JSE Sun JDK 1.6.0_07 DB2 SQL09010 Windows XP James browser 0 0 0 0 0 1754 Passed
2.0 2009-11-11 JPA Tests JSE Sun JDK 1.6.0_07 Derby 10.3.1.4 Windows XP James browser 0 9 2 0 0 1754 Failed case function not supported, blob issue, subquerys with multiple columns
2.0 2009-11-10 JPA Tests JSE Sun JDK 1.6.0_07 H2 1.2 Windows XP James browser 0 0 0 0 0 1754 Passed
2.0 2009-11-05 JPA Tests JSE Sun JDK 1.6.0_07 HSQL 1.8.1 Windows XP James browser 25 6 1 0 0 1720 Failed outer-joins

MOXy

Running the MOXy JUnit tests

Platform Results

Label Test Server JDK Parser OS Ran by Runner Errors Fail Warning Setup failures Setup warning Total Success
1.1 2008-11-25 test-oxm JSE Sun JDK 1.6 Linux Edwin ant 0 0 0 0 0 11061 Passed
1.1 2008-11-25 test-jaxb JSE Sun JDK 1.6 Linux Edwin ant 0 0 0 0 0 400 Passed

SDO

Platform Results

Label Test Server JDK Parser OS Ran by Runner Errors Fail Warning Setup failures Setup warning Total Success
1.1 2008-11-25 SDO JSE Sun JDK 1.6 Linux Edwin ant 0 0 0 0 0 4195 Passed

DBWS

These tests will be added after we have done some planning for the coordination of the test frameworks

Back to the top