Jump to: navigation, search

Difference between revisions of "PDE/API Tools/Testing"

< PDE‎ | API Tools
(Unsupported Javadoc Tags)
(Quick Fixes)
Line 79: Line 79:
  
 
== Quick Fixes  ==
 
== Quick Fixes  ==
 +
All quick fixes should not put a project in a state of error, and should work with an existing modified editor (i.e. even if there are unsaved edits in the editor the quick-fix is being activated on)
 +
 +
*Usage problems
 +
*Compatibility problems
 +
*Version problems
 +
*Since Tag problems
 +
*API Leak problems
  
 
== Filters  ==
 
== Filters  ==

Revision as of 14:35, 26 April 2011

API Tools
Website
Download
Community
Mailing ListForumsIRC
Bugzilla
Open
Help Wanted
Bug Day
Contribute
Browse Source

Test Page Template

Test Page Template: PDE/API Tools/Test Plan Template.

This template must be used to create a new test page for each release that requires testing.

Any new features that are added to the test script must also be added to the feature list section of the template.

Test Passes

API Setup

General

  • setup wizard should have a help topic

Setup API Tooling

  • wizard with no selections in workspace and with selections; if the there are selected projects in the workspace that can have API tooling setup on them, they should be preselected in the wizard
  • try canceling the wizard
  • try selecting / unselecting all to make sure the finish and preview button work as expected</li>
  • try selecting a project and viewing a preview
  • try selecting projects that do and do not have a component.xml file
  • ensure tags are added correctly to files (from the component.xml)

API Baselines

General

  • changing / editing / removing of the default baseline should ask you to build when the Ok button is pressed on the preference page the page and wizard should have help topics

Create a new API baseline

  • try completing the wizard and canceling it
  • try renaming a baseline (accepting and canceling the process)
  • try changing the location of the new baseline and resetting the profile

Edit an API baseline

  • try completing the wizard and canceling it
  • try renaming a baseline (accepting and canceling the process)

Deleting an API baseline

  • try deleting a baseline
  • try deleting select baselines
  • try deleting all baselines

Default Baseline

  • try selecting a new default baseline
  • try editing the default baseline (rename, should still be the default after rename)
  • try deleting the default baseline

Change the warning level for missing default baselines

Building

Full Build

  • Run a full build on one project
  • markers should be updated
  • filters should be respected
  • progress messages should be correct
  • time to build should be reasonable

Run a full build on the workspace

  • builder should only run on 'API aware' projects
  • markers should be updated
  • filters should be respected
  • progress messages should be correct
  • time to build should be reasonable

Incremental Building

  • Change a dependent type
  • builder should run for dependent's
  • markers should be updated for dependent's
  • filters should be respected on type and dependent's
  • time to build should be reasonable

Unsupported Javadoc Tags

Enable the check for unsupported Javadoc tag checking. All of the given tests should produce API problems, and all content assist-available tags should not

  • add noimplement, no reference and nooverride tags to class (inner, outer, static, static inner, etc)
  • add noinstantiate, noextend, noreference and nooverride tags to an interface (annotation)
  • add noimplement, noextend and noinstantiate tags to a method
  • add noimplement, noextend, noreference and noinstantiate tags to a constructor
  • add noimplement, noextend, nooverride and noinstantiate tags to a field
  • add noimplement, noextend, noreference, nooverride and noinstantiate tags to a final field

Quick Fixes

All quick fixes should not put a project in a state of error, and should work with an existing modified editor (i.e. even if there are unsaved edits in the editor the quick-fix is being activated on)

  • Usage problems
  • Compatibility problems
  • Version problems
  • Since Tag problems
  • API Leak problems

Filters

Preferences

Invalid System Library References

Target Platform Stability Workspace Baseline

Use Scan Reference

Run The Test Suite