Skip to main content
Jump to: navigation, search

Difference between revisions of "EclipseLink/Development/Testing/Status"

(→‎Current EclipseLink Test Status)
(→‎Platform Results)
 
(93 intermediate revisions by 2 users not shown)
Line 2: Line 2:
  
 
===Nightly Runs===
 
===Nightly Runs===
−
* [http://www.eclipse.org/eclipselink/testing/index.php Nightly tests run results]
+
* [http://www.eclipse.org/eclipselink/downloads/nightly.php Nightly test run results]
 +
* [http://stame02.us.oracle.com/eclipselink/ Nightly test run results (on Oracle)]
  
 
===Foundation===
 
===Foundation===
Line 8: Line 9:
  
 
====Platform Results====
 
====Platform Results====
 +
Foundation tests are run nightly on Oracle and MySQL.
 +
 +
Release testing is done on several databases including, Oracle, MySQL, DB2, Sybase, SQL Server, Derby, PostgreSQL.
 +
 +
This table can be used to store results from database or environment runs that are not run nightly.
 
<table border=1 cellspacing=0 cellpadding=2>
 
<table border=1 cellspacing=0 cellpadding=2>
 
<tr style="background:#ffdead">
 
<tr style="background:#ffdead">
−
<td>Date last run</td> <td>Test</td> <td>Server</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Pass</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td>
+
<td>Label</td> <td>Test</td> <td>Server</td> <td>JDK</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td> <td>Comments</td>
 
</tr>
 
</tr>
 
<tr>
 
<tr>
−
<td>2007-12-12</td> <td>NonLRGTestModel</td> <td>JSE</td> <td>Oracle 10gR2</td> <td>WinXP</td> <td>James</td> <td>1167</td> <td>1</td> <td>2</td> <td>33</td> <td>8</td> <td>0</td> <td>1203</td> <td>[https://bugs.eclipse.org/bugs/show_bug.cgi?id=212797 Failed]</td>
+
<td>2.0 2009-11-12</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>MySQL 5.1.39</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>209</td> <td>0</td> <td>6</td> <td>8591</td> <td>Passed</td> <td></td>
 
</tr>
 
</tr>
 
<tr>
 
<tr>
−
<td>2007-12-04</td> <td>LRGTestModel</td> <td>JSE</td> <td>Oracle 10g</td> <td>WinXP</td> <td>James</td> <td>6663</td> <td>0</td> <td>0</td> <td>86</td> <td>0</td> <td>0</td> <td>6749</td> <td>Passed</td>
+
<td>2.0 2009-11-12</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>Oracle 11.1.0.0.0</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>84</td> <td>0</td> <td>0</td> <td>8612</td> <td>Passed</td> <td></td>
 
</tr>
 
</tr>
 
<tr>
 
<tr>
−
<td>2007-12-03</td> <td>SRGTestModel</td> <td>JSE</td> <td>MySQL 5</td> <td>WinXP</td> <td>James</td> <td>642</td> <td>0</td> <td>0</td> <td>17</td> <td>0</td> <td>0</td> <td>659</td> <td>Passed</td>
+
<td>2.0 2009-11-12</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>DB2 SQL09010</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>1</td> <td>321</td> <td>0</td> <td>7</td> <td>8564</td> <td>Failed</td> <td>database deadlock in multithreaded test</td>
 
</tr>
 
</tr>
 
<tr>
 
<tr>
−
<td>2007-12-03</td> <td>SRGTestModel</td> <td>JSE</td> <td>Oracle 10g</td> <td>WinXP</td> <td>James</td> <td>659</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>659</td> <td>Passed</td>
+
<td>2.0 2009-11-11</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6</td> <td>Derby 10.3.1.4</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>1</td> <td>12</td> <td>321</td> <td>0</td> <td>7</td> <td>8564</td> <td>Failed</td> <td>locking issue, case function not supported, driver null-pointers</td>
 
</tr>
 
</tr>
 
<tr>
 
<tr>
−
<td>2007-12-03</td> <td>LRGTestModel</td> <td>JSE</td> <td>MySQL 5</td> <td>WinXP</td> <td>James</td> <td>6023</td> <td>0</td> <td>0</td> <td>196</td> <td>0</td> <td>6</td> <td>6219</td> <td>Passed</td>
+
<td>2.0 2009-11-10</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>Firebird 2.13</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>11</td> <td>18</td> <td>219</td> <td>0</td> <td>7</td> <td>8564</td> <td>Failed</td> <td>some functions not supported</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-05</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>HSQL 1.8.1</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>56</td> <td>0</td> <td>219</td> <td>0</td> <td>8</td> <td>8301</td> <td>Failed</td> <td>outer-joins, query-timeouts</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-10-13+</td> <td>LRGTestModel</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>H2 1.2</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>212</td> <td>0</td> <td>10</td> <td>8089</td> <td>Passed</td> <td></td>
 
</tr>
 
</tr>
 
</table>
 
</table>
Line 33: Line 45:
  
 
====Platform Results====
 
====Platform Results====
 +
JPA tests are run nightly on Oracle and MySQL.
 +
 +
Release testing is done on several databases including, Oracle, MySQL, DB2, Sybase, SQL Server, Derby, PostgreSQL.
 +
 +
This table can be used to store results from database or environment runs that are not run nightly.
 
<table border=1 cellspacing=0 cellpadding=2>
 
<table border=1 cellspacing=0 cellpadding=2>
 
<tr style="background:#ffdead">
 
<tr style="background:#ffdead">
−
<td>Date last run</td> <td>Test</td> <td>Server</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Pass</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td>
+
<td>Label</td> <td>Test</td> <td>Server</td> <td>JDK</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td> <td>Comments</td>
 
</tr>
 
</tr>
 
<tr>
 
<tr>
−
<td>2007-12-19</td> <td>fieldaccess.advanced</td> <td>OC4J 11g</td> <td>Oracle 10g</td> <td>WinXP</td> <td>James</td> <td>104</td> <td>4</td> <td>2</td> <td>0</td> <td>0</td> <td>0</td> <td>110</td> <td>Failed</td>
+
<td>2.0 2009-11-12</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>PostgreSQL 8.2.5</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 
</tr>
 
</tr>
 
<tr>
 
<tr>
−
<td>2007-12-19</td> <td>sessionbean</td> <td>OC4J 11g</td> <td>Oracle 10g</td> <td>WinXP</td> <td>James</td> <td>5</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>5</td> <td>Passed</td>
+
<td>2.0 2009-11-12</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>Oracle 11.1.0.0.0</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 
</tr>
 
</tr>
 
<tr>
 
<tr>
 +
<td>2.0 2009-11-12</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>MySQL 5.1.39</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>2</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 +
</tr>
 
<tr>
 
<tr>
−
<td>2007-12-04</td> <td>FullRegressionTestSuite</td> <td>JSE</td> <td>Oracle 10g</td> <td>WinXP</td> <td>James</td> <td>903</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>903</td> <td>Passed</td>
+
<td>2.0 2009-11-11</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>DB2 SQL09010</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 
</tr>
 
</tr>
 
<tr>
 
<tr>
−
<td>2007-12-03</td> <td>AllCMP3TestRunModel</td> <td>JSE</td> <td>MySQL 5</td> <td>WinXP</td> <td>James</td> <td>982</td> <td>7</td> <td>1</td> <td>2</td> <td>0</td> <td>0</td> <td>992</td> <td>[https://bugs.eclipse.org/bugs/show_bug.cgi?id=213465 Failed]</td>
+
<td>2.0 2009-11-11</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>Derby 10.3.1.4</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>9</td> <td>2</td> <td>0</td> <td>0</td> <td>1754</td> <td>Failed</td> <td>case function not supported, blob issue, subquerys with multiple columns</td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-10</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>H2 1.2</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>1754</td> <td>Passed</td> <td></td>
 +
</tr>
 +
<tr>
 +
<td>2.0 2009-11-05</td> <td>JPA Tests</td> <td>JSE</td> <td>Sun JDK 1.6.0_07</td> <td>HSQL 1.8.1</td> <td>Windows XP</td> <td>James</td> <td>browser</td> <td>25</td> <td>6</td> <td>1</td> <td>0</td> <td>0</td> <td>1720</td> <td>Failed</td> <td>outer-joins</td>
 
</tr>
 
</tr>
 
</table>
 
</table>
  
 
===MOXy===
 
===MOXy===
−
* The OXM test suite passes completly
+
[[EclipseLink/Development/TestStatus/MOXy-Instructions| Running the MOXy JUnit tests]]
−
** At last update, 10818 tests run successfully
+
====Platform Results====
−
* The JAXB test suite passes completly
+
<table border=1 cellspacing=0 cellpadding=2>
−
** At last update, 323 tests run successfully
+
<tr style="background:#ffdead">
−
*[[EclipseLink/Development/TestStatus/MOXy-Instructions| Running the MOXy JUnit tests]]
+
<td>Label</td> <td>Test</td> <td>Server</td> <td>JDK</td> <td>Parser</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td>
 +
</tr>
 +
<tr>
 +
<td>1.1 2008-11-25</td> <td>test-oxm</td> <td>JSE</td> <td>Sun JDK 1.6</td> <td></td> <td>Linux</td> <td>Edwin</td> <td>ant</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>11061</td> <td>Passed</td>
 +
</tr>
 +
<tr>
 +
<td>1.1 2008-11-25</td> <td>test-jaxb</td> <td>JSE</td> <td>Sun JDK 1.6</td> <td></td> <td>Linux</td> <td>Edwin</td> <td>ant</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>400</td> <td>Passed</td>
 +
</tr>
 +
</table>
  
 
===SDO===
 
===SDO===
−
*The SDO tests currently are expected to run with '''4 failures and 1 errors'''.
 
−
*At last update, 3805 run, 3795 tests pass
 
−
'''1 Expected Error:'''
 
−
*org.eclipse.persistence.testing.sdo.helper.xmlhelper.loadandsave
 
−
**1 - LoadAndSavePurchaseOrderWithAnnotation:testNoSchemaLoadFromInputStreamSaveDataObjectToString
 
−
***Introduced on 070921 until SDO spec. resolution is received.
 
−
 
−
'''4 Expected Failures:'''
 
−
*4 in org.eclipse.persistence.testing.sdo.helper.xmlhelper.loadandsave
 
−
**new failures - verifyAfterLoad assertion.
 
−
*1 Known intermittent failure (to be fixed) that increase the failures by '''1''' - that tests concurrency issues with open content properties
 
−
** in org.eclipse.persistence.testing.helper.helpercontext.SDOHelperContextMultiThreadedTest
 
−
 
−
Work will be done in the near future to bring the pass rate to 100%
 
−
 
 
*[[EclipseLink/Development/TestStatus/SDO-Instructions| Building & Running the SDO JUnit tests]]
 
*[[EclipseLink/Development/TestStatus/SDO-Instructions| Building & Running the SDO JUnit tests]]
 +
====Platform Results====
 +
<table border=1 cellspacing=0 cellpadding=2>
 +
<tr style="background:#ffdead">
 +
<td>Label</td> <td>Test</td> <td>Server</td> <td>JDK</td> <td>Parser</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Errors</td> <td>Fail</td> <td>Warning</td> <td>Setup failures</td> <td>Setup warning</td> <td>Total</td> <td>Success</td>
 +
</tr>
 +
<tr>
 +
<td>1.1 2008-11-25</td> <td>SDO</td> <td>JSE</td> <td>Sun JDK 1.6</td> <td></td> <td>Linux</td> <td>Edwin</td> <td>ant</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>0</td> <td>4195</td> <td>Passed</td>
 +
</tr>
 +
</table>
  
 
===DBWS===
 
===DBWS===

Latest revision as of 17:04, 12 November 2009

Current EclipseLink Test Status

Nightly Runs

Foundation

Running the foundation tests

Platform Results

Foundation tests are run nightly on Oracle and MySQL.

Release testing is done on several databases including, Oracle, MySQL, DB2, Sybase, SQL Server, Derby, PostgreSQL.

This table can be used to store results from database or environment runs that are not run nightly.

Label Test Server JDK Database OS Ran by Runner Errors Fail Warning Setup failures Setup warning Total Success Comments
2.0 2009-11-12 LRGTestModel JSE Sun JDK 1.6.0_07 MySQL 5.1.39 Windows XP James browser 0 0 209 0 6 8591 Passed
2.0 2009-11-12 LRGTestModel JSE Sun JDK 1.6.0_07 Oracle 11.1.0.0.0 Windows XP James browser 0 0 84 0 0 8612 Passed
2.0 2009-11-12 LRGTestModel JSE Sun JDK 1.6.0_07 DB2 SQL09010 Windows XP James browser 0 1 321 0 7 8564 Failed database deadlock in multithreaded test
2.0 2009-11-11 LRGTestModel JSE Sun JDK 1.6 Derby 10.3.1.4 Windows XP James browser 1 12 321 0 7 8564 Failed locking issue, case function not supported, driver null-pointers
2.0 2009-11-10 LRGTestModel JSE Sun JDK 1.6.0_07 Firebird 2.13 Windows XP James browser 11 18 219 0 7 8564 Failed some functions not supported
2.0 2009-11-05 LRGTestModel JSE Sun JDK 1.6.0_07 HSQL 1.8.1 Windows XP James browser 56 0 219 0 8 8301 Failed outer-joins, query-timeouts
2.0 2009-10-13+ LRGTestModel JSE Sun JDK 1.6.0_07 H2 1.2 Windows XP James browser 0 0 212 0 10 8089 Passed

JPA

Running the JPA LRG

Platform Results

JPA tests are run nightly on Oracle and MySQL.

Release testing is done on several databases including, Oracle, MySQL, DB2, Sybase, SQL Server, Derby, PostgreSQL.

This table can be used to store results from database or environment runs that are not run nightly.

Label Test Server JDK Database OS Ran by Runner Errors Fail Warning Setup failures Setup warning Total Success Comments
2.0 2009-11-12 JPA Tests JSE Sun JDK 1.6.0_07 PostgreSQL 8.2.5 Windows XP James browser 0 0 0 0 0 1754 Passed
2.0 2009-11-12 JPA Tests JSE Sun JDK 1.6.0_07 Oracle 11.1.0.0.0 Windows XP James browser 0 0 0 0 0 1754 Passed
2.0 2009-11-12 JPA Tests JSE Sun JDK 1.6.0_07 MySQL 5.1.39 Windows XP James browser 0 0 2 0 0 1754 Passed
2.0 2009-11-11 JPA Tests JSE Sun JDK 1.6.0_07 DB2 SQL09010 Windows XP James browser 0 0 0 0 0 1754 Passed
2.0 2009-11-11 JPA Tests JSE Sun JDK 1.6.0_07 Derby 10.3.1.4 Windows XP James browser 0 9 2 0 0 1754 Failed case function not supported, blob issue, subquerys with multiple columns
2.0 2009-11-10 JPA Tests JSE Sun JDK 1.6.0_07 H2 1.2 Windows XP James browser 0 0 0 0 0 1754 Passed
2.0 2009-11-05 JPA Tests JSE Sun JDK 1.6.0_07 HSQL 1.8.1 Windows XP James browser 25 6 1 0 0 1720 Failed outer-joins

MOXy

Running the MOXy JUnit tests

Platform Results

Label Test Server JDK Parser OS Ran by Runner Errors Fail Warning Setup failures Setup warning Total Success
1.1 2008-11-25 test-oxm JSE Sun JDK 1.6 Linux Edwin ant 0 0 0 0 0 11061 Passed
1.1 2008-11-25 test-jaxb JSE Sun JDK 1.6 Linux Edwin ant 0 0 0 0 0 400 Passed

SDO

Platform Results

Label Test Server JDK Parser OS Ran by Runner Errors Fail Warning Setup failures Setup warning Total Success
1.1 2008-11-25 SDO JSE Sun JDK 1.6 Linux Edwin ant 0 0 0 0 0 4195 Passed

DBWS

These tests will be added after we have done some planning for the coordination of the test frameworks

Retrieved from "https://wiki.eclipse.org/index.php?title=EclipseLink/Development/Testing/Status&oldid=179115"

This page was last modified 17:04, 12 November 2009 by James . Based on work by Edwin Tang, Denise Mahar and David McCann and others.

Back to the top