Difference between revisions of "DSDP/MTJ/Tests/Manual"

Revision as of 14:20, 11 July 2008

This is the MTJ Manual Test Plan. Tasks are outlined very briefly only. Feel free to do some exploratory testing around the suggested items.

Standard usability tests

Preferences Pages

• Walk through each of the Preferences and enable/disable them
  • Check: The outcome is what you expect?
  • Check: Are the Preferences documented sufficiently?
  • Check: The preferences can be restored to default values?

Device Management Page

• Check: Can import Devices
• Check: Can edit Devices
• Check: Can delete Devices
• Check: Can duplicate Devices

New MIDlet Project Page

• Resource folder field
  • Check: Can specify a resource folder name
  • Check: If you specify a folder name, the next project you create uses it as resource folder?

Over the Air Page

• Check: Can enable preferences

Packaging Page

• Check: Can add/remove "Excluded Manifest Entries"

Obfuscation Page

• Check: Can configure Proguard settings

Preverification Page

• Check: "Use Built-in preverifier" can't be selected

Import Device Wizard

• Check: The Finish button is disabled before finding a device?
• Check: The Select All and Deselect All buttons are disabled before finding a device?
• Check: The Refresh button is disabled before specifying the search directory?
• Check: The Finish button is disabled before finding a device?
• Check: Choosing an folder without any device inside and pressing Refresh will result in no devices found
• Check: Choosing an folder with devices inside and pressing Refresh will result in the list of devices found
• Check: Finishing the wizard after finding at least one device, will add the device list to the Device Management Page

Device Editor

• Basic Page
  • Check: fields can be edited and the changes reflect in the Device Management Page
• Libraries Page
  • Check: can add and remove libraries
  • Check: can define javadoc for library
  • Check: can define source for library

• Properties Page
  • Check: Cant edit, add or remove properties.

MIDlet Project

New MIDlet Project Wizard

• Check: "Mobile Tools for Java" category exists

• "Mobile Tools for Java" Category
  • Check: MIDlet Project in category
• MIDlet Suite Properties
  • Check: Can manage Devices
  • Check: Can change Application descriptor name
  • Check: When one device is selected and Application descriptor field is empty the Next and Finish buttons must be disabled
  • Check: When one device is selected and Application descriptor field has an invalid value (i.e. something.txt) the Next and Finish buttons must be disabled
  • Check: When no device is selected and Application descriptor field is empty the Next and Finish buttons must be disabled
  • Check: When no device is selected and Application descriptor field has valid value (i.e. something.jad) the Next and Finish buttons must be disabled
  • Check: When one device is selected and Application descriptor field has valid value (i.e. something.jad) the Next and Finish buttons must be enabled
• Java settings
  • Check: Can edit Java settings
  • Libraries Tab
    • Check: "Java ME Library" corresponds to the device selected in previous page.
    • Check: If another device is selected, the change is reflected in "Java ME Library"

• Check: The wizard can be canceled at any time.
• Check: The user can go back to the previous wizard page at any time
• Check: The wizard can be finished at any time.

Project Properties

• Check: "Mobile Tools for Java" category exists
• Check: Can change project device (This change must reflect on project's "Java ME Library")
• Check: Can change JAD file name
• Check: Can change JAR file name
• MIDlet Suite Signing
  • Check: Can configure signing settings
  • Check: If correctly configured the MIDlet project must be correctly signed
• Obfuscation
  • Check: If "Enable project specific settings" is enabled, this settings must override the default configuration
  • Check: Can configure obfuscation settings
• Packaging
  • Check: If "Enable project specific settings" is enabled, this settings must override the default configuration
  • Check: Can configure packaging settings
• Preverification
  • Check: If "Enable project specific settings" is enabled, this settings must override the default configuration
  • Check: Can configure preverification settings

Jad Editor

• Check: Any property edited by the Jad Editor must be updated in the <project_jad_file>.jad
  • Required Properties Page
  • MIDlets Page
  • Optional Properties Page
  • Over the Air Properties Page
  • Push Registry Page
  • Used Defined Properties Page

Project's Context Sensitive Menu

• MIDlet Suite Project
  • Check: Can create package
  • Check: If "Proguard" is correctly configured, can create obfuscated package
  • Check: If "Antenna" is correctly configured, can export Antenna build files.
• Regular Java Project/Other Project
  • Check: Can convert to MIDlet Project

Run/Debug Dialog

• MIDlet tab
  • Check: Can edit settings
• Emulation tab
  • Check: Can set a specific device to run/debug
  • Check: If "Specific Device" is selected, can manage devices

User and Legal Documentation

Verify User Docs

• Walk through tutorial, Context Help, Check Links, Search feature

Verify Legal

• Feature Descriptions, Licenses in all source features, Overall license