Skip to main content

Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

Difference between revisions of "WSDL Test Plan"

 
(47 intermediate revisions by 4 users not shown)
Line 1: Line 1:
 +
__NOTOC__
 
<table width="100%">
 
<table width="100%">
 
<tr>
 
<tr>
 
<td width="80%" align="top">
 
<td width="80%" align="top">
−
<br><b><big>WSDL Editor test plan</big></b>
+
<br><b><big>WSDL Component Test Plan</big></b>
−
<br><b><big>WTP 1.5 Milestone 6</big></b>
+
<br><b><big>WTP 1.5 Final</big></b>
 
<td>
 
<td>
 
http://www.eclipse.org//webtools/images/wtplogosmall.jpg
 
http://www.eclipse.org//webtools/images/wtplogosmall.jpg
Line 11: Line 12:
 
<table width="100%"><tr><td valign="top" bgcolor="#0080c0"><big><b><font face="Arial,Helvetica" color="#ffffff">&nbsp;&nbsp;Task Oriented Tests</font></b></big></td>
 
<table width="100%"><tr><td valign="top" bgcolor="#0080c0"><big><b><font face="Arial,Helvetica" color="#ffffff">&nbsp;&nbsp;Task Oriented Tests</font></b></big></td>
 
</tr></table>
 
</tr></table>
−
<h3>Test Case 1 : Start From Scratch</h3>
+
<h3>Test Case 1 : Start From Scratch - Standalone</h3>
 
<ol>
 
<ol>
 
<li>
 
<li>
−
Use the New XML Schema Wizard to create a new schema (alternative) Use New File to create a blank 'xsd' file ... everything should still work
+
Use the New WSDL Wizard to create a new wsdl (alternative) Use New File to create a blank 'wsdl' file ... everything should still work
 
<br/>
 
<br/>
 
</li>
 
</li>
 
<br/>
 
<br/>
−
<li>Select a 'target' schema that you can attempt to reproduce. Here's some suggestions but feel free to come up with your own
+
<li>
 +
Select a 'target' WSDL that you can attempt to reproduce. Here's some suggestions but feel free to come up with your own
  
 
<ul>
 
<ul>
−
  <table border='1'>
+
        <table border='1'>
−
    <tr bgcolor="#CCCCCC">
+
<tr bgcolor="#CCCCCC">
−
      <td>Description</td>
+
        <td>Description</td>
−
      <td>Where</td>
+
<td>Where</td>
−
    </tr>
+
                </tr>
−
    <tr>
+
<tr>
−
      <td>GolfCourse</td>
+
<td>PhoneBanking</td>
−
      <td>XML Examples Project</td>  
+
<td>XML Examples Project</td>
−
    </tr>
+
</tr>
−
    <tr>
+
<tr>
−
      <td>SpaceWarGame</td>
+
<td>Google Search API</td>
−
         
+
<td>[http://api.google.com/GoogleSearch.wsdl link]</td>
−
      <td>XML Examples Project</td>  
+
</tr>
−
    </tr>
+
<tr>
−
    <tr>
+
<td>Fax</td>
−
      <td>OrgChart</td>
+
<td>[http://www.sms.mio.it/webservices/sendmessages.asmx?WSDL link]</td>
−
      <td>XML Examples Project</td>  
+
</tr>
−
    </tr>  
+
</table>
−
  </table>  
+
 
</ul>
 
</ul>
 
</li>
 
</li>
 
<br/>
 
<br/>
−
<li>Using the target schema as a guide, utilize the design view to reproduce it. Attempt to use a top down flow since this best simulates how
+
<li>
−
a user would go about building from scratch (e.g. start with the main elements and types and work your way down to the leaf elements and types).
+
Using the target WSDL as a guide, utilize the design view to reproduce it. Attempt to use a top down flow since this best simulates how a user would go about building from scratch (e.g. start with the main elements and types and work your way down to the leaf objects.
 
Be sure to open bugs if...
 
Be sure to open bugs if...
  
 
<ul>
 
<ul>
−
  <li>you run into quirky problems that make editing feel unnatural</li>
+
        <li>you run into quirky problems that make editing feel unnatural</li>
−
  <li>you need to go off to the outline or source view to work around problems</li>
+
<li>you need to go off to the outline or source view to work around problems</li>
−
  <li>you hit performance problems that affect your productivity</li>
+
<li>you hit performance problems that affect your productivity</li>
−
  <li>etc.</li>
+
<li>etc.</li>
 
</ul>
 
</ul>
  
 
</li>
 
</li>
 
<br/>
 
<br/>
−
<li>When you think your schema is complete, use the validator to ensure it's valid.
+
<li>
 +
When you think your WSDL is complete, use the validator to ensure it's valid.
 
<ul>
 
<ul>
−
  <li>since the editor was used to author the schema there should be very</li>
+
<li>
−
  <li>few validation problems (if any) look at these carefully and consider why
+
Since the editor was used to author the document there should be very few validation problems (if any).  If there are some look at these carefully and consider why the editor produced these.</li>
−
the editor produced these.</li>
+
<li>some of the validation problems are unavoidable but in general the editor should be fairly good at protecting the users against 'bad' WSDLs </li>
−
  <li>some of the validation problems are unavoidable but in general
+
<li>if there are problems it's likely that the user will need to use the source view to fix them</li>
−
the editor should be fairly good at protecting the users against 'bad'
+
<li>ensure that all problems can be fixed in the source view and that red squggles work
−
schemas)</li>
+
<li>as you fix things in the source view ensure that red squiggle indicators go away</li>
−
<br/>
+
<li>ensure that when you flip back to the design view that any source changes are reflected in the view</li>
−
<li>if there are problems it's likely that the user will need to use
+
−
the source view to fix them</li>
+
−
<li>ensure that all problems can be fixed in the source view and that
+
−
red squggles work</li>
+
−
<li>as you fix things in the source view ensure that red squiggle indicators
+
−
go away</li>
+
−
<li>ensure that when you flip back to the design view that any source
+
−
view changes are reflected in the design view</li>
+
 
</ul>
 
</ul>
  
 
</li>
 
</li>
 
<br/>
 
<br/>
−
<li>As a final test open an XML file that validates for the 'target'
+
<li>As a final test open use the 'jst' tools to generate and deploy a skeleton web services for the WSDL</li>
−
schema and edit a copy so that it point to the 'new' schema. Ensure
+
</ol>
−
the XML file validates against the 'new' schema.  If it doesn't validate
+
−
ensure the schema editor helps you fix the problems.
+
−
</li></ol>
+
 
----
 
----
  
 
<h3><b>Test Case 2 : Start From Scratch - One Piece of a Larger Project</b></h3>
 
<h3><b>Test Case 2 : Start From Scratch - One Piece of a Larger Project</b></h3>
 
<ol>
 
<ol>
−
<li>Repeat Test Case 1 but recreate a schema that's a part of a multi-schema project. Here's some examples...
+
<li>Repeat Test Case 1 but recreate a WSDL that's uses a muti-file pattern . Here's some examples...
 
<ul>
 
<ul>
−
  <table border='1'>
+
<table border='1'>
−
    <tr bgcolor="#CCCCCC">
+
<tr bgcolor="#CCCCCC">
−
      <td>Name</td>
+
<td>Name</td>
−
      <td>Where</td>
+
<td>Where</td>
−
    </tr>
+
</tr>
−
    <tr>
+
<tr>
−
      <td>SpaceWarGame-b</td>
+
<td>SpaceWarGame-b</td>
−
      <td>XML Examples Project</td>  
+
<td>XML Examples Project</td>
−
    </tr>
+
</tr>
−
    <tr>
+
<tr>
−
      <td>oagis-8</td>
+
<td>PhoneBanking-b</td>
−
      <td><a href="http://www.openapplications.org/downloads/oagidownloads.htm">link</a></td>  
+
<td>XML Examples Project</td>
−
    </tr>
+
</tr>
−
  </table>
+
</table>
 
</ul>
 
</ul>
 
</li>
 
</li>
−
<li>Be sure to utilize the 'Browse...' function when editing type and element references.
+
<li>Be sure to utilize the 'Browse...' function when editing type and element references.</li>
−
</li>
+
<li>Inspect the WSDL after using 'Browse...' to ensure that the &lt;include&gt; or &lt;import&gt; and the 'xmlns:xxx' gets updated correctly.</li>
−
<li>Inspect the schema after using 'Browse...' to ensure that the &lt;include&gt;
+
<li>Inspect the source view after using 'Browse...' to ensure the type or element reference is not red squiggled (and muck with it to make sure the squiggle does show when expected)</li>
−
or &lt;import&gt; and the 'xmlns:xxx' gets updated correctly.
+
−
</li>
+
−
<li>Inspect the source view after using 'Browse...' to ensure the type or element reference is not red squiggled (and muck with it to make sure
+
−
the squiggle does show when expected)
+
−
</li>
+
 
</ol>
 
</ol>
 
<br/>
 
<br/>
 
----
 
----
−
<h3><b>Test Case 3 : Visualize and Browse a Large Schema</b></h3>
+
 
 +
<h3><b>Test Case 3 : Visualize and Browse a Large/Complex WSDL</b></h3>
 
<ol>
 
<ol>
−
<li>Select a schema that we want to view.
+
<li>Select a WSDL that we want to view.</li>
−
</li>
+
<li>Use the design view to naviagate the WSDL and open referenced XML Schemas. Ensure all of the following work...
−
<br/>
+
−
<li>Use the design view to naviagate thru the schema(s). Ensure all of the following work...
+
 
<br/>
 
<br/>
 
<ul>
 
<ul>
−
  <li>click on items listed in the top level view to ensure 'open on' works</li>
+
<li>click on the 'arrow' beside an element or complex type in the portType ... ensure a schema editor is opened and the 'clicked' object is shown</li>
−
  <li> double click on type headers to 'open on' works</li>
+
<li>after following a chain of referenes, ensure the 'back arrow' button allows you to reverse back up the chain</li>
−
  <li> after following a chain of referenes, ensure the 'back arrow' button
+
<li>expand the binding objects to ensure they layout correctly in their 'ruler-ish' form</li>
−
allows you to reverse back up the chain</li>
+
−
  <li>as you navigate ensure the design view displays the correct thing
+
−
      and the layout and line routing is correct</li>    
+
 
</ul>
 
</ul>
−
<br/>  
+
<br/>
−
<li>Use the source view to naviage thru the schema(s). Ensure all of the following work...
+
<li>Use the source view to naviage thru the WSDLs and XSDs. Ensure all of the following work...
 
<br/>
 
<br/>
 
<ul>
 
<ul>
−
  <li>hold down crtl to see the hyperlinks as you mouse over them, ensure
+
<li>hold down crtl to see the hyperlinks as you mouse over them, ensure hyperlins appear for all 'references'</li>
−
hyperlins appear for all 'references'
+
<li>ctrl-lick or F3 on hypelinks to ensure 'open on' works</li>
−
  </li>
+
<li>after following a chain of referenes, ensure the 'back arrow' button allows you to reverse back up the chain</li>
−
  <li>ctrl-lick or F3 on hypelinksto ensure 'open on' works</li>
+
−
  <li>after following a chain of referenes, ensure the 'back arrow' button
+
−
allows you to reverse back up the chain</li>
+
 
</ul>
 
</ul>
 
</li>
 
</li>
 
<br/>
 
<br/>
−
<li>Browse the schema(s) by flipping between both the design and source
+
<li>Navigate thru the WSDLs and XSDs using both the design and source view (flipping between 'em) and ensure both modes of navigation work together nicely.</li>
−
view and ensure source view and design view navigation work together nicely.
+
−
</li>
+
 
<br/>
 
<br/>
−
<li>Use the outline view in conjuction with the source and design view.
+
<li>Use the outline view in conjuction and ensure it interacts as expected with the source and design view</li>
−
</li>
+
 
<br/>
 
<br/>
−
<li>From the source, design and outline views. Use the 'references-&gt;project'
+
<li>From the source, design and outline views. Use the 'references-&gt;project' or 'references->workspace' for several components (portTypes, bindings, types, elements etc.) to understand how components are reused.</li>
−
or 'references->workspace' for several components (types, elements etc.)
+
−
to understand how components are reused in the schema(s).
+
−
</li>
+
−
</li>
+
−
</ol>
+
−
----
+
−
<h3><b>Test Case 4 : Refactor a large schema project</b></h3>
+
−
<ol>
+
−
<li>a) Select one of the existing refactoring 'before and after' projects form the list below
+
−
<br/>-- or ---
+
−
<br/>b) Use any project and come up with a reorganization 'plan' (change
+
−
names, move things around etc.) that will describe your 'target' project.
+
−
</li>
+
−
<li>Use the editor's editing and refactoring support to make the existing
+
−
project look like the 'target' project.
+
−
</li>
+
−
<li>After each refactoring is applied ensure that the project validates.
+
 
</li>
 
</li>
 
</ol>
 
</ol>
  
 +
__NOTOC__
  
−
__NOTOC__
 
−
</table>
 
 
<table width="100%"><tr><td valign="top" bgcolor="#0080c0"><big><b><font face="Arial,Helvetica" color="#ffffff">&nbsp;&nbsp;Function Oriented Tests</font></b></big></td>
 
<table width="100%"><tr><td valign="top" bgcolor="#0080c0"><big><b><font face="Arial,Helvetica" color="#ffffff">&nbsp;&nbsp;Function Oriented Tests</font></b></big></td>
 
</tr></table>
 
</tr></table>
−
 
+
<h3><b>New WSDL Wizard</b></h3>
−
<h3><b>Actions Tests</b></h3>
+
−
 
+
 
<ol>
 
<ol>
−
<li>
+
<li>Try the various options available on the New WSDL file options page
−
add element (from design and outline)</li>
+
<ul>
−
 
+
        <li>option to create WSDL Skeleton</li>
−
<li>
+
<li>SOAP...document literal, rpc literal, rpc encoded</li>
−
add complex type (from design and outline)</li>
+
<li>HTTP...HTTP GET, HTTP POST</li>
−
 
+
</ul>
−
<li>
+
−
add simple type</li>
+
−
 
+
−
<li>
+
−
add include/import/redefine</li>
+
−
 
+
−
<li>
+
−
add group</li>
+
−
 
+
−
<li>
+
−
add global attribute</li>
+
−
 
+
−
<li>
+
−
add attribute group</li>
+
−
 
+
−
<li>
+
−
add sequence</li>
+
−
 
+
−
<li>
+
−
add choice</li>
+
−
 
+
−
<li>
+
−
delete</li>
+
−
 
+
−
<li>
+
−
show properties</li>
+
−
 
+
−
<li>
+
−
set type</li>
+
−
 
+
−
<li>
+
−
set multiplicity</li>
+
−
 
+
−
<li>
+
−
Test 'Edit Namespaces...' action from the schema properties</li>
+
−
 
+
−
<li>
+
 
</li>
 
</li>
 
</ol>
 
</ol>
−
 
+
−
<p/>
+
<h3><b>design View</b></h3>
−
<hr WIDTH="100%"/>
+
−
<h3><b>Synchronization Tests</b></h3>
+
−
 
+
−
<p>Selection synchronization
+
 
<ol>
 
<ol>
−
 
+
<li>Top Level View
−
<li>
+
        <ul>
−
With the design view shown, select from outline - see if design and properties
+
<li>Actions to add/remove/rename components</li>
−
views are updated</li>
+
<li>Open Schema/WSDL Imports</li>
−
 
+
<li>Imported WSDL components should appear but not be editable</li>
−
<li>
+
<li>Inline Schemas located in the 'top level' view should allow drill down</li>
−
With the design view shown, select from design - see if outline and properties
+
<li>Connecting lines should appear to show WSDL component relationships</li>
−
views are updated</li>
+
</ul>
−
 
+
</li>
−
<li>
+
<li>In Drilled Down View of Schema Components...
−
Repeat for Source view</li>
+
<ul>
 +
<li>Test that menus show proper content for different objects</li>
 +
<li>Test Drag and Drop</li>
 +
<li>Ensure deleting the 'top level' component pops you back to the top view</li>
 +
<li>Test selection of 'simple type' icon within an element declaration</li>
 +
<li>Content that originates via derivation should be demarked with dotted box</li>
 +
</ul>
 +
</li>
 
</ol>
 
</ol>
−
</p>
+
−
<p>
+
<h3><b>Outline View</b></h3>
−
Synchronization due to Model Changes
+
 
<ol>
 
<ol>
−
 
+
<li>Selection from Outline view should select the corresponding object in the design view</li>
−
<li>
+
<li>Context menu for a particular component should be the same in both the design and Outline views</li>
−
synchronization tests - change name of element from design - see if outline
+
−
and properties are updated</li>
+
−
 
+
−
<li>
+
−
add/delete from the outline - verify (top level schema view)</li>
+
−
 
+
−
<li>
+
−
edit from tabbed properties - verify views</li>
+
−
 
+
−
<li>
+
−
edit from the source view - ensure the views are updated</li>
+
−
 
+
−
<li>
+
−
cut and paste sections to/from source view</li>
+
−
 
+
−
<li>
+
−
make various random changes in the souce view and then undo</li>
+
−
 
+
−
<li>
+
−
delete and restore element declarations from source and ensure references
+
−
are updated</li>
+
−
 
+
−
<li>
+
−
change a file locally and refresh</li>
+
 
</ol>
 
</ol>
−
</p>
+
−
<hr WIDTH="100%"/>
+
−
<h3><b>Design View</b></h3>
+
−
 
+
−
<ol>
+
−
<li>
+
−
drag and drop</li>
+
−
 
+
−
<li>
+
−
drill down elements, complex types, simple types, attributes, attribute
+
−
groups, groups</li>
+
−
 
+
−
<li>
+
−
Top Level View</li>
+
−
 
+
−
<ol>
+
−
<li>
+
−
Actions to add/remove components</li>
+
−
 
+
−
<br/>Menu actions for 'categories' should only provide actions appicable
+
−
to category (e.g. element category should have 'Add Element')
+
−
<li>
+
−
Open Schema action</li>
+
−
 
+
−
<li>
+
−
Direct editing for a newly created 'named' component</li>
+
−
 
+
−
<li>
+
−
Imported components should not appear in 'top level' view</li>
+
−
 
+
−
<li>
+
−
Components with 'structure' should allow 'drill down'</li>
+
−
 
+
−
<li>
+
−
Components with 'null' names should show 'nice' labels</li>
+
−
</ol>
+
−
 
+
−
<li>
+
−
Actions to 'drill down' and return 'Back to Schema View'</li>
+
−
 
+
−
<li>
+
−
In Drilled Down View of Components...</li>
+
−
 
+
−
<ol>
+
−
<li>
+
−
Test that menus show proper content for different objects</li>
+
−
 
+
−
<li>
+
−
Test Drag and Drop</li>
+
−
 
+
−
<li>
+
−
Ensure deleting the 'top level' component pops you back to the top view</li>
+
−
 
+
−
<li>
+
−
Test selection of 'simple type' icon within an element declaration</li>
+
−
 
+
−
<li>
+
−
Content that originates via derivation should be demarked with dotted box</li>
+
−
</ol>
+
−
 
+
−
<li>
+
−
Selection from other views should drill down if required</li>
+
−
 
+
−
<ol>
+
−
<li>
+
−
Easy Selection of Simple Types within elements</li>
+
−
</ol>
+
−
 
+
−
<li>
+
−
</li>
+
−
</ol>
+
−
 
+
−
<hr WIDTH="100%"/>
+
 
<h3><b>Source View</b></h3>
 
<h3><b>Source View</b></h3>
−
 
 
<ol>
 
<ol>
−
<li>
+
<li>Test editing features
−
as-you-type validation</li>
+
<ul>
−
 
+
        <li>Add WSDL Components</li>
−
<li>
+
<li>Delete from source</li>
−
navigation</li>
+
<li>Copy and paste</li>
−
 
+
<li>Test for invalid content</li>
−
<li>
+
</ul>
−
Test editing features</li>
+
−
 
+
−
<ol>
+
−
<li>
+
−
Add XSD Components</li>
+
−
 
+
−
<li>
+
−
Delete from source</li>
+
−
 
+
−
<li>
+
−
Copy and paste</li>
+
−
 
+
−
<li>
+
−
Test for invalid content</li>
+
−
</ol>
+
−
 
+
−
<li>
+
−
Test 'standard' xml content assist support (see xml source editor) for
+
−
adding schema elements</li>
+
−
 
+
−
<li>
+
−
Test 'schema specific' content assist for the following attribute values...</li>
+
−
 
+
−
<ol>
+
−
<li>
+
−
element 'type' attribute</li>
+
−
 
+
−
<li>
+
−
element 'ref' attribute</li>
+
−
 
+
−
<li>
+
−
model group 'ref' attribute</li>
+
−
 
+
−
<li>
+
−
attribute group 'ref' attribute</li>
+
−
 
+
−
<li>
+
−
complex type's 'base' attribute</li>
+
−
</ol>
+
−
 
+
−
<li>
+
 
</li>
 
</li>
 +
<li>Test 'standard' xml content assist support (see xml source editor) for adding WSDL and schema elements</li>
 
</ol>
 
</ol>
−
 
+
−
<hr WIDTH="100%"/>
+
 
<h3><b>Properties View</b></h3>
 
<h3><b>Properties View</b></h3>
−
 
 
<ol>
 
<ol>
−
<li>
+
<li>Properties view should be available for all selected schema components</li>
−
Properties view should be available for all selected schema components</li>
+
<li>Test that view can't be 'broken'... should always have 'good' content</li>
−
 
+
<li>Imported WSDL components should not be editable through the properties</li>
−
<li>
+
<li>Renaming components should 'auto refactor' within source file (references to renamed component should be updated)</li>
−
General Tab</li>
+
<li>Update documentation for various components</li>
−
 
+
−
<li>
+
−
Extensions tab</li>
+
−
 
+
−
<li>
+
−
Constraints tab for simple types</li>
+
−
 
+
−
<ul>
+
−
<li>
+
−
Test enumerations</li>
+
−
 
+
−
<li>
+
−
Test patterns</li>
+
−
 
+
−
<li>
+
−
Test facets</li>
+
−
</ul>
+
−
 
+
−
<li>
+
−
Documention tab</li>
+
 
</ol>
 
</ol>
−
 
+
−
<p/><br/>
+
<h3><b>Set Existing Component Dialog</b></h3>
−
<hr WIDTH="100%"/>
+
−
<h3><b>Outline View</b></h3>
+
−
 
+
 
<ol>
 
<ol>
−
<li>
+
<li>Set Existing Component Dialog launched via the context menu or properties
−
Test that click on a 'drillable top level component' causes drill down</li>
+
<ul>
−
 
+
<li>Port</li>
−
<li>
+
<li>Binding</li>
−
Check content of tree</li>
+
<li>Input</li>
 +
<li>Output</li>
 +
<li>Fault</li>
 +
<li>Part</li>
 +
</ul>
 +
</li>
 +
<li>Adjust the search scope. The available components displayed should be updated</li>
 +
<li>The text filter located at the top of the dialog is used to filter the available types</li>
 
</ol>
 
</ol>
−
 
+
−
<p/><br/>
+
<h3><b>Generate Binding Content</b></h3>
−
<hr WIDTH="100%"/>
+
−
<h3><b>Resource File Tests</b></h3>
+
−
 
+
 
<ol>
 
<ol>
−
<li>
+
<li>Click on a Binding and select "Generate Binding Content..." from the context menu. Select the "Overwrite existing binding information option". Ensure the proper binding information is generated</li>
−
Save</li>
+
<li>Test out the different Binding options (SOAP, HTTP, etc...)</li>
−
 
+
−
<li>
+
−
Save As</li>
+
−
 
+
−
<li>
+
−
Edit file externally</li>
+
 
</ol>
 
</ol>
−
 
+
−
<p/><br/>
+
<h3><b>Smart Renaming</b></h3>
−
<hr WIDTH="100%"/>
+
−
<h3><b>Validation</b></h3>
+
−
 
+
 
<ol>
 
<ol>
−
<li>
+
<li>Test smart renaming on the following Components
−
as you type validation</li>
+
<ul>
−
 
+
<li>Operation</li>
−
<li>
+
<li>Fault</li>
−
change type from string to stringssssssss to see squiggles</li>
+
<li>Message</li>
−
 
+
<li>Part</li>
−
<li>
+
</ul>
 
</li>
 
</li>
 +
<li>Renaming one of the above elements should also rename it's 'children' if the 'child' has a generated name. For example, "MyOperationName" (Operation) --> Input --> "MyOperationNameRequest" (Message) --> "MyOperationNameRequest" (Part) A rename on Operation to "NewOp" will cause the following result: "newOpName" (Operation) --> Input --> "newOpNameRequest" (Message) --> "newOpNameRequest" (Part)</li>
 +
<li>The same pattern follows when renaming a Fault, Message, and Part</li>
 +
<li>Initiate renaming via the context menu or the properties view</li>
 
</ol>
 
</ol>
  
−
<p/><br/>
+
<h3><b>Imports</b></h3>
−
<hr WIDTH="100%"/>
+
−
<h3><b>New XSD Wizard</b></h3>
+
−
 
+
 
<ol>
 
<ol>
−
<li>
+
<li>WSDL imports
−
Create new schemas and ensure file names when prompted are unique for each
+
<ul>
−
project</li>
+
<li>Test adding them via outline/properties view and via source view</li>
 +
<li>Verify imported objects show up in design view (may need to close and reopen editor</li>
 +
<li>Verify new components are available in the 'set type' dialog</li>
 +
<li>Verify import shows up in outline view</li>
 +
</ul>
 +
</li>
 +
<li>XSD imports
 +
<ul>
 +
<li>Test adding them via the 'set type' dialog will add xsd import to the wsdl</li>
 +
<li>Verify new components are available in the 'set type' dialog</li>
 +
<li>Verify xsd:import and wsdl:import cannot be interchanged and using one instead of the other will result in validaiton error</li>
 +
</ul>
 +
</li>
 +
<li>Unused imports
 +
<ul>
 +
<li>Check preferences under Web Services->WSDL Files</li>
 +
<li>Test that unused WSDL and XSD imports are removed</li>
 +
</ul>
 +
</li>
 
</ol>
 
</ol>
−
 
+
−
<p/>
+
−
<hr WIDTH="100%"/>
+
−
<h3><b>XML Catalog Support</b></h3>
+
−
 
+
−
<ol>
+
−
<li>
+
−
Test that editor respects catalog when resolving schema locations</li>
+
−
 
+
−
<li>
+
−
Test multiple levels of imports</li>
+
−
</ol>
+
−
 
+
−
<hr WIDTH="100%"/>
+
−
 
+
 
<h3><b>General</b></h3>
 
<h3><b>General</b></h3>
−
 
 
<ol>
 
<ol>
−
<li>
+
<li>Test the various menu actions available for different components</li>
−
Set Types Dialog</li>
+
<li>Reload dependancies action from the WSDL Editor menu bar</li>
−
 
+
<li>Test 'Edit Namespaces...' action</li>
−
<li>
+
<li>Menu actions for 'categories' should only provide actions appicable to that particular category (e.g. element category should have 'Add Element')</li>
−
Set Element Reference Dialog</li>
+
<li>Undo/Redo</li>
−
 
+
<li>View selection synchronization</li>
−
<li>
+
<li>Editing synchronization : source -&gt; model (perform source changes below and ensure model is intact)</li>
−
Undo/Redo</li>
+
<ul>
−
 
+
<li>cut and paste sections to/from source view</li>
−
<li>
+
<li>make various random changes in the souce view and then undo</li>
−
F3 support</li>
+
<li>delete and restore component declarations from source and ensure references are updated</li>
−
 
+
<li>change a file locally and refresh</li>
−
<ol>
+
</ul>
−
<li>
+
<li>Editing synchronization : model -&gt; source (perform designical changes below and ensure source is intact)</li>
−
From the source view, F3 on component references should cause selection
+
<ul>
−
to 'jump' to referenced component</li>
+
<li>make random changes to the WSDL model via the graphical views</li>
−
 
+
<li>make various changes in the souce view and then undo</li>
−
<li>
+
</ul>
−
F3 on imports or includes should 'open schema'</li>
+
<li>F3 support
−
 
+
<ul>
−
<li>
+
<li>F3 on component references should cause selection to 'jump' to referenced component</li>
−
Double click on an include/import from the design view to open editor</li>
+
<li>F3 on imports should open the imported schema or WSDL</li>
 +
</ul>
 +
</li>
 
</ol>
 
</ol>
  
−
<li>
 
−
Included components are greyed and menus/properties are read-only</li>
 
  
−
<li>
+
<table width="100%"><tr><td valign="top" bgcolor="#0080c0"><big><b><font face="Arial,Helvetica" color="#ffffff">&nbsp;&nbsp;Performance Tests</font></b></big></td>
−
Support for Refactoring</li>
+
</tr></table>
  
−
<ol>
+
<div id="example">an id attribute
−
<li>
+
</div>
−
rename</li>
+
<h3>Performance Test 1 : Validation</h3>
 +
# Perform a 'full' validation of a large project (see list of project in Usage Test 2)
 +
# Open an applicable artifact in the editor and type in the source page to ensure 'as you type' validation is responive
 +
# Test validation on projects that contain references to external URLs
 +
# Validate in disconnected mode (no internet access)
 +
# Run JUnit validation performance tests
 +
<br/>
  
−
<li>
+
<h3>Performance Test 2 : Opening the Editor</h3>
−
make local element global</li>
+
# Test how many editors can be opened at once
 +
#* Import a large project into the workspace with many applicable artifacts
 +
#* Open an editor for each artifact until you run out of memory (hint : use multi-select and open)
 +
# Test how how quickly an editor opens
 +
#* Use a very large artifact
 +
#* Use an artifact that pulls in lots of other artifacts
  
−
<li>
+
<h3>Performance Test 3 : Editing Responsiveness</h3>
−
make anonymous type global</li>
+
# Add and Remove various objects
 +
#* from the design view
 +
#* from the outline
 +
#* from the source view
 +
# Typing in the source view
 +
#* rename an element (type quickly on the keyboard)
 +
# Open on
 +
#* from the design view
 +
#* from the source view
  
−
<li>
+
<h3>Performance Test 4 : Search and Refactoring</h3>
−
</li>
+
* Using a mediumm or large sized schema project
−
</ol>
+
** select a component and test 'refereces->workspace'
−
</ol>
+
** select a component and refactor->rename (with preview and without)
−
 
+
** record timings for both 'cold' and 'warm' starts
−
<br/>
+

Latest revision as of 11:55, 19 September 2008


WSDL Component Test Plan
WTP 1.5 Final

http://www.eclipse.org//webtools/images/wtplogosmall.jpg

  Task Oriented Tests

Test Case 1 : Start From Scratch - Standalone

  1. Use the New WSDL Wizard to create a new wsdl (alternative) Use New File to create a blank 'wsdl' file ... everything should still work


  2. Select a 'target' WSDL that you can attempt to reproduce. Here's some suggestions but feel free to come up with your own
      Description Where
      PhoneBanking XML Examples Project
      Google Search API link
      Fax link


  3. Using the target WSDL as a guide, utilize the design view to reproduce it. Attempt to use a top down flow since this best simulates how a user would go about building from scratch (e.g. start with the main elements and types and work your way down to the leaf objects. Be sure to open bugs if...
    • you run into quirky problems that make editing feel unnatural
    • you need to go off to the outline or source view to work around problems
    • you hit performance problems that affect your productivity
    • etc.


  4. When you think your WSDL is complete, use the validator to ensure it's valid.
    • Since the editor was used to author the document there should be very few validation problems (if any). If there are some look at these carefully and consider why the editor produced these.
    • some of the validation problems are unavoidable but in general the editor should be fairly good at protecting the users against 'bad' WSDLs
    • if there are problems it's likely that the user will need to use the source view to fix them
    • ensure that all problems can be fixed in the source view and that red squggles work
    • as you fix things in the source view ensure that red squiggle indicators go away
    • ensure that when you flip back to the design view that any source changes are reflected in the view


  5. As a final test open use the 'jst' tools to generate and deploy a skeleton web services for the WSDL

Test Case 2 : Start From Scratch - One Piece of a Larger Project

  1. Repeat Test Case 1 but recreate a WSDL that's uses a muti-file pattern . Here's some examples...
      Name Where
      SpaceWarGame-b XML Examples Project
      PhoneBanking-b XML Examples Project
  2. Be sure to utilize the 'Browse...' function when editing type and element references.
  3. Inspect the WSDL after using 'Browse...' to ensure that the <include> or <import> and the 'xmlns:xxx' gets updated correctly.
  4. Inspect the source view after using 'Browse...' to ensure the type or element reference is not red squiggled (and muck with it to make sure the squiggle does show when expected)


Test Case 3 : Visualize and Browse a Large/Complex WSDL

  1. Select a WSDL that we want to view.
  2. Use the design view to naviagate the WSDL and open referenced XML Schemas. Ensure all of the following work...
    • click on the 'arrow' beside an element or complex type in the portType ... ensure a schema editor is opened and the 'clicked' object is shown
    • after following a chain of referenes, ensure the 'back arrow' button allows you to reverse back up the chain
    • expand the binding objects to ensure they layout correctly in their 'ruler-ish' form


  3. Use the source view to naviage thru the WSDLs and XSDs. Ensure all of the following work...
    • hold down crtl to see the hyperlinks as you mouse over them, ensure hyperlins appear for all 'references'
    • ctrl-lick or F3 on hypelinks to ensure 'open on' works
    • after following a chain of referenes, ensure the 'back arrow' button allows you to reverse back up the chain


  4. Navigate thru the WSDLs and XSDs using both the design and source view (flipping between 'em) and ensure both modes of navigation work together nicely.


  5. Use the outline view in conjuction and ensure it interacts as expected with the source and design view


  6. From the source, design and outline views. Use the 'references->project' or 'references->workspace' for several components (portTypes, bindings, types, elements etc.) to understand how components are reused.


  Function Oriented Tests

New WSDL Wizard

  1. Try the various options available on the New WSDL file options page
    • option to create WSDL Skeleton
    • SOAP...document literal, rpc literal, rpc encoded
    • HTTP...HTTP GET, HTTP POST

design View

  1. Top Level View
    • Actions to add/remove/rename components
    • Open Schema/WSDL Imports
    • Imported WSDL components should appear but not be editable
    • Inline Schemas located in the 'top level' view should allow drill down
    • Connecting lines should appear to show WSDL component relationships
  2. In Drilled Down View of Schema Components...
    • Test that menus show proper content for different objects
    • Test Drag and Drop
    • Ensure deleting the 'top level' component pops you back to the top view
    • Test selection of 'simple type' icon within an element declaration
    • Content that originates via derivation should be demarked with dotted box

Outline View

  1. Selection from Outline view should select the corresponding object in the design view
  2. Context menu for a particular component should be the same in both the design and Outline views

Source View

  1. Test editing features
    • Add WSDL Components
    • Delete from source
    • Copy and paste
    • Test for invalid content
  2. Test 'standard' xml content assist support (see xml source editor) for adding WSDL and schema elements

Properties View

  1. Properties view should be available for all selected schema components
  2. Test that view can't be 'broken'... should always have 'good' content
  3. Imported WSDL components should not be editable through the properties
  4. Renaming components should 'auto refactor' within source file (references to renamed component should be updated)
  5. Update documentation for various components

Set Existing Component Dialog

  1. Set Existing Component Dialog launched via the context menu or properties
    • Port
    • Binding
    • Input
    • Output
    • Fault
    • Part
  2. Adjust the search scope. The available components displayed should be updated
  3. The text filter located at the top of the dialog is used to filter the available types

Generate Binding Content

  1. Click on a Binding and select "Generate Binding Content..." from the context menu. Select the "Overwrite existing binding information option". Ensure the proper binding information is generated
  2. Test out the different Binding options (SOAP, HTTP, etc...)

Smart Renaming

  1. Test smart renaming on the following Components
    • Operation
    • Fault
    • Message
    • Part
  2. Renaming one of the above elements should also rename it's 'children' if the 'child' has a generated name. For example, "MyOperationName" (Operation) --> Input --> "MyOperationNameRequest" (Message) --> "MyOperationNameRequest" (Part) A rename on Operation to "NewOp" will cause the following result: "newOpName" (Operation) --> Input --> "newOpNameRequest" (Message) --> "newOpNameRequest" (Part)
  3. The same pattern follows when renaming a Fault, Message, and Part
  4. Initiate renaming via the context menu or the properties view

Imports

  1. WSDL imports
    • Test adding them via outline/properties view and via source view
    • Verify imported objects show up in design view (may need to close and reopen editor
    • Verify new components are available in the 'set type' dialog
    • Verify import shows up in outline view
  2. XSD imports
    • Test adding them via the 'set type' dialog will add xsd import to the wsdl
    • Verify new components are available in the 'set type' dialog
    • Verify xsd:import and wsdl:import cannot be interchanged and using one instead of the other will result in validaiton error
  3. Unused imports
    • Check preferences under Web Services->WSDL Files
    • Test that unused WSDL and XSD imports are removed

General

  1. Test the various menu actions available for different components
  2. Reload dependancies action from the WSDL Editor menu bar
  3. Test 'Edit Namespaces...' action
  4. Menu actions for 'categories' should only provide actions appicable to that particular category (e.g. element category should have 'Add Element')
  5. Undo/Redo
  6. View selection synchronization
  7. Editing synchronization : source -> model (perform source changes below and ensure model is intact)
    • cut and paste sections to/from source view
    • make various random changes in the souce view and then undo
    • delete and restore component declarations from source and ensure references are updated
    • change a file locally and refresh
  8. Editing synchronization : model -> source (perform designical changes below and ensure source is intact)
    • make random changes to the WSDL model via the graphical views
    • make various changes in the souce view and then undo
  9. F3 support
    • F3 on component references should cause selection to 'jump' to referenced component
    • F3 on imports should open the imported schema or WSDL


  Performance Tests
an id attribute

Performance Test 1 : Validation

  1. Perform a 'full' validation of a large project (see list of project in Usage Test 2)
  2. Open an applicable artifact in the editor and type in the source page to ensure 'as you type' validation is responive
  3. Test validation on projects that contain references to external URLs
  4. Validate in disconnected mode (no internet access)
  5. Run JUnit validation performance tests


Performance Test 2 : Opening the Editor

  1. Test how many editors can be opened at once
    • Import a large project into the workspace with many applicable artifacts
    • Open an editor for each artifact until you run out of memory (hint : use multi-select and open)
  2. Test how how quickly an editor opens
    • Use a very large artifact
    • Use an artifact that pulls in lots of other artifacts

Performance Test 3 : Editing Responsiveness

  1. Add and Remove various objects
    • from the design view
    • from the outline
    • from the source view
  2. Typing in the source view
    • rename an element (type quickly on the keyboard)
  3. Open on
    • from the design view
    • from the source view

Performance Test 4 : Search and Refactoring

  • Using a mediumm or large sized schema project
    • select a component and test 'refereces->workspace'
    • select a component and refactor->rename (with preview and without)
    • record timings for both 'cold' and 'warm' starts
Retrieved from "https://wiki.eclipse.org/index.php?title=WSDL_Test_Plan&oldid=119409"

This page was last modified 11:55, 19 September 2008 by Amy Wu. Based on work by Jeffrey Liu, Craig Salter and Craig Salter and others.

Back to the top