Skip to main content
Jump to: navigation, search

Difference between revisions of "EclipseLink/Development/Testing/Status"

(Platform Results)
(Platform Results)
 
(117 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 
==Current EclipseLink Test Status==
 
==Current EclipseLink Test Status==
 +
 +
===Nightly Runs===
 +
* [http://www.eclipse.org/eclipselink/downloads/nightly.php Nightly test run results]
 +
* [http://stame02.us.oracle.com/eclipselink/ Nightly test run results (on Oracle)]
  
 
===Foundation===
 
===Foundation===
Line 5: Line 9:
  
 
====Platform Results====
 
====Platform Results====
 +
Foundation tests are run nightly on Oracle and MySQL.
 +
 +
Release testing is done on several databases including, Oracle, MySQL, DB2, Sybase, SQL Server, Derby, PostgreSQL.
 +
 +
This table can be used to store results from database or environment runs that are not run nightly.
 
<table border=1 cellspacing=0 cellpadding=2>
 
<table border=1 cellspacing=0 cellpadding=2>
 
<tr style="background:#ffdead">
 
<tr style="background:#ffdead">
<td>Date last run</td> <td>Test</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Pass</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td>
+
<td>Label</td> <td>Test</td> <td>Server</td> <td>JDK</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td> <td>Comments</td>
 
</tr>
 
</tr>
 
<tr>
 
<tr>
<td>2007-12-03</td> <td>SRGTestModel</td> <td>MySQL 5</td> <td>WinXP</td> <td>James</td> <td>642</td> <td>0</td> <td>17</td> <td>0</td> <td>0</td> <td>659</td>
+
<td>2.0 2009-11-12</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>MySQL 5.1.39</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>209</td> <td>0</td> <td>6</td> <td>8591</td> <td>Passed</td> <td></td>
 
</tr>
 
</tr>
 
<tr>
 
<tr>
<td>2007-12-03</td> <td>SRGTestModel</td> <td>Oracle 10g</td> <td>WinXP</td> <td>James</td> <td>659</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>659</td>
+
<td>2.0 2009-11-12</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>Oracle 11.1.0.0.0</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>84</td> <td>0</td> <td>0</td> <td>8612</td> <td>Passed</td> <td></td>
 
</tr>
 
</tr>
 
<tr>
 
<tr>
<td>2007-12-03</td> <td>LRGTestModel</td> <td>MySQL 5</td> <td>WinXP</td> <td>James</td> <td>6023</td> <td>0</td> <td>196</td> <td>0</td> <td>6</td> <td>6219</td>
+
<td>2.0 2009-11-12</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>DB2 SQL09010</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>1</td> <td>321</td> <td>0</td> <td>7</td> <td>8564</td> <td>Failed</td> <td>database deadlock in multithreaded test</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-11</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6</td> <td>Derby 10.3.1.4</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>1</td> <td>12</td> <td>321</td> <td>0</td> <td>7</td> <td>8564</td> <td>Failed</td> <td>locking issue, case function not supported, driver null-pointers</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-10</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>Firebird 2.13</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>11</td> <td>18</td> <td>219</td> <td>0</td> <td>7</td> <td>8564</td> <td>Failed</td> <td>some functions not supported</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-05</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>HSQL 1.8.1</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>56</td> <td>0</td> <td>219</td> <td>0</td> <td>8</td> <td>8301</td> <td>Failed</td> <td>outer-joins, query-timeouts</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-10-13+</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>H2 1.2</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>212</td> <td>0</td> <td>10</td> <td>8089</td> <td>Passed</td> <td></td>
 
</tr>
 
</tr>
 
</table>
 
</table>
Line 23: Line 44:
 
[[EclipseLink/Test/JPA| Running the JPA LRG]]
 
[[EclipseLink/Test/JPA| Running the JPA LRG]]
  
====MySQL====
+
====Platform Results====
* The FullRegressionSuite has only a few failures when run on MySQL 5
+
JPA tests are run nightly on Oracle and MySQL.
** At last update, 873 tests run. There are 6 errors and 1 failure.
+
** 4 of the errors are related to calling StoredProcedures
+
** 1 of the errors is related to an outer join
+
** 1 of the errors occurs in a sessions.xml test
+
** The failure is a warning related to RAW types on PKs only working on Oracle
+
** Work will be done in the near future to bring the pass rate to 100%
+
  
====Oracle====
+
Release testing is done on several databases including, Oracle, MySQL, DB2, Sybase, SQL Server, Derby, PostgreSQL.
  
* The FullRegressionTestSuite passes completely when run on Oracle 10.2
+
This table can be used to store results from database or environment runs that are not run nightly.
** at last update: 874 of 874 tests pass
+
<table border=1 cellspacing=0 cellpadding=2>
 +
<tr style="background:#ffdead">
 +
<td>Label</td> <td>Test</td> <td>Server</td> <td>JDK</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td> <td>Comments</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-12</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>PostgreSQL 8.2.5</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-12</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>Oracle 11.1.0.0.0</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-12</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>MySQL 5.1.39</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>2</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-11</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>DB2 SQL09010</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-11</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>Derby 10.3.1.4</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>9</td> <td>2</td> <td>0</td> <td>0</td> <td>1754</td> <td>Failed</td> <td>case function not supported, blob issue, subquerys with multiple columns</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-10</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>H2 1.2</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-05</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>HSQL 1.8.1</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>25</td> <td>6</td> <td>1</td> <td>0</td> <td>0</td> <td>1720</td> <td>Failed</td> <td>outer-joins</td>
 +
</tr>
 +
</table>
  
 
===MOXy===
 
===MOXy===
* The OXM test suite passes completly
+
[[EclipseLink/Development/TestStatus/MOXy-Instructions| Running the MOXy JUnit tests]]
** At last update, 10818 tests run successfully
+
====Platform Results====
* The JAXB test suite passes completly
+
<table border=1 cellspacing=0 cellpadding=2>
** At last update, 323 tests run successfully
+
<tr style="background:#ffdead">
*[[EclipseLink/Development/TestStatus/MOXy-Instructions| Running the MOXy JUnit tests]]
+
<td>Label</td> <td>Test</td> <td>Server</td> <td>JDK</td> <td>Parser</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td>
 +
</tr>
 +
<tr>
 +
<td>1.1 2008-11-25</td> <td>test-oxm</td> <td>JSE</td> <td>Sun JDK 1.6</td> <td></td> <td>Linux</td> <td>Edwin</td> <td>ant</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>11061</td> <td>Passed</td>
 +
</tr>
 +
<tr>
 +
<td>1.1 2008-11-25</td> <td>test-jaxb</td> <td>JSE</td> <td>Sun JDK 1.6</td> <td></td> <td>Linux</td> <td>Edwin</td> <td>ant</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>400</td> <td>Passed</td>
 +
</tr>
 +
</table>
  
 
===SDO===
 
===SDO===
*The SDO tests currently are expected to run with '''4 failures and 1 errors'''.
 
*At last update, 3805 run, 3795 tests pass
 
'''1 Expected Error:'''
 
*org.eclipse.persistence.testing.sdo.helper.xmlhelper.loadandsave
 
**1 - LoadAndSavePurchaseOrderWithAnnotation:testNoSchemaLoadFromInputStreamSaveDataObjectToString
 
***Introduced on 070921 until SDO spec. resolution is received.
 
 
'''4 Expected Failures:'''
 
*4 in org.eclipse.persistence.testing.sdo.helper.xmlhelper.loadandsave
 
**new failures - verifyAfterLoad assertion.
 
*1 Known intermittent failure (to be fixed) that increase the failures by '''1''' - that tests concurrency issues with open content properties
 
** in org.eclipse.persistence.testing.helper.helpercontext.SDOHelperContextMultiThreadedTest
 
 
Work will be done in the near future to bring the pass rate to 100%
 
 
 
*[[EclipseLink/Development/TestStatus/SDO-Instructions| Building & Running the SDO JUnit tests]]
 
*[[EclipseLink/Development/TestStatus/SDO-Instructions| Building & Running the SDO JUnit tests]]
 +
====Platform Results====
 +
<table border=1 cellspacing=0 cellpadding=2>
 +
<tr style="background:#ffdead">
 +
<td>Label</td> <td>Test</td> <td>Server</td> <td>JDK</td> <td>Parser</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td>
 +
</tr>
 +
<tr>
 +
<td>1.1 2008-11-25</td> <td>SDO</td> <td>JSE</td> <td>Sun JDK 1.6</td> <td></td> <td>Linux</td> <td>Edwin</td> <td>ant</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>4195</td> <td>Passed</td>
 +
</tr>
 +
</table>
  
 
===DBWS===
 
===DBWS===
 
These tests will be added after we have done some planning for the coordination of the test frameworks
 
These tests will be added after we have done some planning for the coordination of the test frameworks
 +
 +
[[Category:EclipseLink|TestStatus]]

Latest revision as of 17:04, 12 November 2009

Current EclipseLink Test Status

Nightly Runs

Foundation

Running the foundation tests

Platform Results

Foundation tests are run nightly on Oracle and MySQL.

Release testing is done on several databases including, Oracle, MySQL, DB2, Sybase, SQL Server, Derby, PostgreSQL.

This table can be used to store results from database or environment runs that are not run nightly.

Label Test Server JDK Database OS Ran by Runner Errors Fail Warning Setup failures Setup warning Total Success Comments
2.0 2009-11-12 LRGTestModel JSE Sun JDK 1.6.0_07 MySQL 5.1.39 Windows XP James browser 0 0 209 0 6 8591 Passed
2.0 2009-11-12 LRGTestModel JSE Sun JDK 1.6.0_07 Oracle 11.1.0.0.0 Windows XP James browser 0 0 84 0 0 8612 Passed
2.0 2009-11-12 LRGTestModel JSE Sun JDK 1.6.0_07 DB2 SQL09010 Windows XP James browser 0 1 321 0 7 8564 Failed database deadlock in multithreaded test
2.0 2009-11-11 LRGTestModel JSE Sun JDK 1.6 Derby 10.3.1.4 Windows XP James browser 1 12 321 0 7 8564 Failed locking issue, case function not supported, driver null-pointers
2.0 2009-11-10 LRGTestModel JSE Sun JDK 1.6.0_07 Firebird 2.13 Windows XP James browser 11 18 219 0 7 8564 Failed some functions not supported
2.0 2009-11-05 LRGTestModel JSE Sun JDK 1.6.0_07 HSQL 1.8.1 Windows XP James browser 56 0 219 0 8 8301 Failed outer-joins, query-timeouts
2.0 2009-10-13+ LRGTestModel JSE Sun JDK 1.6.0_07 H2 1.2 Windows XP James browser 0 0 212 0 10 8089 Passed

JPA

Running the JPA LRG

Platform Results

JPA tests are run nightly on Oracle and MySQL.

Release testing is done on several databases including, Oracle, MySQL, DB2, Sybase, SQL Server, Derby, PostgreSQL.

This table can be used to store results from database or environment runs that are not run nightly.

Label Test Server JDK Database OS Ran by Runner Errors Fail Warning Setup failures Setup warning Total Success Comments
2.0 2009-11-12 JPA Tests JSE Sun JDK 1.6.0_07 PostgreSQL 8.2.5 Windows XP James browser 0 0 0 0 0 1754 Passed
2.0 2009-11-12 JPA Tests JSE Sun JDK 1.6.0_07 Oracle 11.1.0.0.0 Windows XP James browser 0 0 0 0 0 1754 Passed
2.0 2009-11-12 JPA Tests JSE Sun JDK 1.6.0_07 MySQL 5.1.39 Windows XP James browser 0 0 2 0 0 1754 Passed
2.0 2009-11-11 JPA Tests JSE Sun JDK 1.6.0_07 DB2 SQL09010 Windows XP James browser 0 0 0 0 0 1754 Passed
2.0 2009-11-11 JPA Tests JSE Sun JDK 1.6.0_07 Derby 10.3.1.4 Windows XP James browser 0 9 2 0 0 1754 Failed case function not supported, blob issue, subquerys with multiple columns
2.0 2009-11-10 JPA Tests JSE Sun JDK 1.6.0_07 H2 1.2 Windows XP James browser 0 0 0 0 0 1754 Passed
2.0 2009-11-05 JPA Tests JSE Sun JDK 1.6.0_07 HSQL 1.8.1 Windows XP James browser 25 6 1 0 0 1720 Failed outer-joins

MOXy

Running the MOXy JUnit tests

Platform Results

Label Test Server JDK Parser OS Ran by Runner Errors Fail Warning Setup failures Setup warning Total Success
1.1 2008-11-25 test-oxm JSE Sun JDK 1.6 Linux Edwin ant 0 0 0 0 0 11061 Passed
1.1 2008-11-25 test-jaxb JSE Sun JDK 1.6 Linux Edwin ant 0 0 0 0 0 400 Passed

SDO

Platform Results

Label Test Server JDK Parser OS Ran by Runner Errors Fail Warning Setup failures Setup warning Total Success
1.1 2008-11-25 SDO JSE Sun JDK 1.6 Linux Edwin ant 0 0 0 0 0 4195 Passed

DBWS

These tests will be added after we have done some planning for the coordination of the test frameworks

Back to the top