Difference between revisions of "Lyo/LyoTestSuite"

From Eclipsepedia

< Lyo
Jump to: navigation, search
(New page: = Lyo OSLC Test Suite = == Goals == The goal of the Lyo OSLC Test Suite is to provide a suite of tests which will test OSLC domain provider implementations against the specification. An...)
 
(OSLC Specifications Covered)
(9 intermediate revisions by 2 users not shown)
Line 1: Line 1:
= Lyo OSLC Test Suite =
+
= Lyo OSLC Test Suite =
  
== Goals ==
+
== Goals ==
The goal of the Lyo OSLC Test Suite is to provide a suite of tests which will test OSLC domain provider implementations against the specification.  An initial suite is now available in the project Git repository.  The suite is under development and does not provide full coverage of the implementations it tests at this time.  The goals of the OSLC Test Suite are to:
+
* provide conformance tests for each of the OSLC domains
+
** priority is to cover MUST items first followed by SHOULD and then MAY items
+
** provide reporting to show provider implementations how conforming they are.
+
* provide a tool to find bugs in OSLC providers and improve their quality
+
  
== Areas for Improvement ==
+
The goal of the Lyo OSLC Test Suite is to provide a suite of tests which will test OSLC domain provider implementations against the specification. A JUnit-based test suite is now available in the project Git repository. The suite is under development and does not provide full coverage of the implementations it tests at this time. The goals of the OSLC Test Suite are to:
* Increased coverage for currently supported specifications
+
* Coverage for OSLC specifications not currently tested
+
* Integrated reporting
+
* Improved query tests
+
* Improved OAuth tests
+
  
== Building and running the OSLC Test Suites
+
*provide assessment tests for each of the OSLC domains
 +
**priority is to cover MUST items first followed by SHOULD and then MAY items
 +
**provide reporting to show provider implementations an assessment report of coverage and successful execution.
 +
*provide a tool to find bugs in OSLC providers and improve their quality
  
See [[BuildTestSuite | Building and running the OSLC Test Suites]]
+
== OSLC Specifications Covered ==
 +
* Change Management (V1 and V2)
 +
* Asset Management (V1 and V2)
 +
* Quality Management (V2)
 +
* Requirements Management (V2)
 +
* Automation Management (V2)
 +
* Performance Monitoring (V2)
 +
 
 +
== Areas for Improvement  ==
 +
 
 +
*Increased coverage for currently supported specifications
 +
*Coverage for OSLC specifications not currently tested
 +
*Integrated reporting
 +
*Improved query tests
 +
*Improved OAuth tests
 +
 
 +
== Building and running the OSLC Test Suites and Reports  ==
 +
 
 +
* [http://git.eclipse.org/c/lyo/org.eclipse.lyo.testsuite.git/tree/org.eclipse.lyo.testsuite.server/compliance/rtc/documentation/HowToRunOSLCProviderTestsAndGenerateComplianceReport.doc Detailed documentation] for the OSLC Test Suite and Reports in MS Word format.
 +
  * Overview of the test suites
 +
  * How to run the tests
 +
  * How to create reports
 +
* [[Lyo/BuildTestSuite| For Developers: Building and running the OSLC test suite]]

Revision as of 13:38, 14 May 2013

Contents

Lyo OSLC Test Suite

Goals

The goal of the Lyo OSLC Test Suite is to provide a suite of tests which will test OSLC domain provider implementations against the specification. A JUnit-based test suite is now available in the project Git repository. The suite is under development and does not provide full coverage of the implementations it tests at this time. The goals of the OSLC Test Suite are to:

  • provide assessment tests for each of the OSLC domains
    • priority is to cover MUST items first followed by SHOULD and then MAY items
    • provide reporting to show provider implementations an assessment report of coverage and successful execution.
  • provide a tool to find bugs in OSLC providers and improve their quality

OSLC Specifications Covered

  • Change Management (V1 and V2)
  • Asset Management (V1 and V2)
  • Quality Management (V2)
  • Requirements Management (V2)
  • Automation Management (V2)
  • Performance Monitoring (V2)

Areas for Improvement

  • Increased coverage for currently supported specifications
  • Coverage for OSLC specifications not currently tested
  • Integrated reporting
  • Improved query tests
  • Improved OAuth tests

Building and running the OSLC Test Suites and Reports

  * Overview of the test suites
  * How to run the tests
  * How to create reports