Difference between revisions of "EclipseLink/Development/Testing/Status"

Revision as of 14:41, 19 October 2007

Current EclipseLink Test Status

Foundation

Running the legacy LRG

MySQL

• The SRGTestModel has a small number of failures on MySQL 5
  • At last update 638 of 650 tests pass and there are 17 warnings
  • There are 3 FatalErrors in the QueryFrameworkTestSuite related to Null not being a valid DB type
  • There is 1 Error in the UnitOfWorkTestSuite related to a foreign key issue.
  • Work will be done in the near future to bring the pass rate to 100%
• The LRGTestModel runs with moderate success on MySQL 5
  • At last update, 5088 run, 4869 tests pass, and there are 191 warnings
  • 16 test models fail to setup
  • There are 19 Errors
  • There are 9 FatalErrors
  • Work will be done in the near future to bring the pass rate to 100%

Oracle

• The SRGTestModel should pass when run on Oracle 10.2
  • At last update 659 of 659 SRGTestModel tests pass
• The LRGTestModel should pass when run on Oracle 10.2
  • At last update 6661 of 6741 tests pass (with 80 warnings and 0 failures)

JPA

Running the JPA Junit tests

MySQL

• The FullRegressionSuite has only a few failures when run on MySQL 5
  • At last update, 873 tests run. There are 6 errors and 1 failure.
  • 4 of the errors are related to calling StoredProcedures
  • 1 of the errors is related to an outer join
  • 1 of the errors occurs in a sessions.xml test
  • The failure is a warning related to RAW types on PKs only working on Oracle
  • Work will be done in the near future to bring the pass rate to 100%

Oracle

• The FullRegressionTestSuite passes completely when run on Oracle 10.2
  • at last update: 874 of 874 tests pass

MOXy

• The OXM test suite passes completly
  • At last update, 10818 tests run successfully
• The JAXB test suite passes completly
  • At last update, 323 tests run successfully
• View the JUnit test summary here
• Running the MOXy unit tests

SDO

• The SDO tests currently are expected to run with 16 failures and 12 errors.
• At last update, 3807 run, 3795 tests pass

12 Expected Errors:

• org.eclipse.persistence.testing.sdo.helper.xmlhelper.loadandsave
  • 10 - testLoadFromDomSourceWithURIAndOptionsSaveDataObjectToStreamResult
    • Each loadandsave suite will have one of these expected for the myAnyTypeTest root.
  • 1 - LoadAndSaveSchemaTypesTestCase:testClassGenerationLoadAndSave
    • Class generation error.
  • 1 - LoadAndSavePurchaseOrderWithAnnotation:testNoSchemaLoadFromInputStreamSaveDataObjectToString
    • Introduced on 070921 until SDO spec. resolution is received.

16 Expected Failures:

• 4 in org.eclipse.persistence.testing.sdo.helper.xmlhelper.loadandsave
  • new failures - verifyAfterLoad assertion.
• 4 in org.eclipse.persistence.testing.sdo.helper.xsdhelper.defineandgenerate
  • new failures - XML comparison error.
• 7 in org.eclipse.persistence.testing.sdo.helper.xsdhelper.generate
  • older failures involving schema generation comparision failure
• 1 in org.eclipse.persistence.testing.sdo.model.type
  • SDOTypeInstanceClassTestCase:testInstanceClassInvlaidNameWithNullInstanceClass - older existing failure.

• 1 Known intermittent failure (to be fixed) that may bring the failures to 17 that tests concurrency issues with open content properties
  • in org.eclipse.persistence.testing.helper.helpercontext.SDOHelperContextMultiThreadedTest

Work will be done in the near future to bring the pass rate to 100%

• View the JUnit test summary here
• Running the SDO JUnit tests

DBWS

These tests will be added after we have done some planning for the coordination of the test frameworks