DSDP/MTJ/Tests/Manual

From Eclipsepedia

< DSDP‎ | MTJ‎ | Tests
Revision as of 07:58, 24 December 2008 by Wds057.motorola.com (Talk | contribs)

Jump to: navigation, search

This is the MTJ Manual Test Plan. Tasks are outlined very briefly only. Feel free to do some exploratory testing around the suggested items, or suggest new test cases.

Contents

Standard usability tests

When testing, make sure that the settings changed were correctly applied, producing the expected behavior. E.g. If you select an specific device to run a MIDlet in a run dialog, make sure that you run the MIDlet and the device running is the selected one.

Preferences Pages

  • Walk through all of the preferences items in "Mobile Tools for Java" category and change their values
    • Check: The outcome is what you expect?
    • Check: Are the Preferences documented sufficiently?
    • Check: The preferences can be restored to default values?
Device Management Page
  • Check: Can import Devices
  • Check: Can edit Devices
  • Check: Can delete Devices
  • Check: Can duplicate Devices
Editors Page
  • Check: Can change the configuration of the 'Localization Data Highlighting'
  • Check: The configuration of the 'Localization Data Highlighting' reflects on the editor
New MIDlet Project Page
  • Resource folder field
    • Check: Can specify a resource folder name
    • Check: If you specify a folder name, the next project you create uses it as resource folder?
Over the Air Page
  • Check: Can change settings and the changes work as expected?
Packaging Page
  • Check: Can add/remove "Excluded Manifest Entries"
Obfuscation Page
  • Check: Can configure Proguard settings
Preverification Page
  • Check: "Use Built-in preverifier" can't be selected

Import Device Wizard

  • Check: The Finish button is disabled before finding a device?
  • Check: The Select All and Deselect All buttons are disabled before finding a device?
  • Check: The Refresh button is disabled before specifying the search directory?
  • Check: Choosing a folder without any device inside and pressing Refresh will result in no devices found (the device list will remain empty)
  • Check: Choosing a folder with devices inside and pressing Refresh will result in the device list filled with the devices found
  • Check: Pressing Finish button after finding at least one device, will add the device list to the Device Management Page

Device Editor

  • Basic Page
  • Libraries Page
    • Check: can add and remove libraries
    • Check: can define javadoc for library
    • Check: can define source for library
  • Properties Page
    • Check: Can not edit, add or remove properties.

MIDlet Project

New MIDlet Project Wizard

  • Check: "Mobile Tools for Java" category exists
  • "Mobile Tools for Java" Category
    • Check: MIDlet Project in category
  • MIDlet Suite Properties
    • Check: Can manage Devices
    • Check: Can change Application descriptor name
    • Check: The Next and Finish buttons must be disabled in invalid scenarios, such as:
  1. A configuration is added and Application descriptor field is empty
  2. A configuration is added but Application descriptor field has an invalid value (i.e. something.txt)
  3. No configuration is added and Application descriptor field is empty
  4. No configuration is added and Application descriptor field has valid value (i.e. something.jad)
    • Check: When one or more configuration is added and Application descriptor field has valid value (i.e. something.jad) the Next and Finish buttons must be enabled
  • Select a Library
    • Check: Can select a library
    • Check: Can deselect a library
    • Check: Can view the details of a library
    • Check: The Sample library is available to be selected
    • Check: All libraries that use properly the Extension Point available in org.eclipse.mtj.core.library Plug-in are available to be selected
  • Java settings
    • Check: Can edit Java settings
    • Libraries Tab
      • Check: "Java ME Library" corresponds to the device selected in previous page.
      • Check: If another device is selected, the change is reflected in "Java ME Library"
  • Check: The wizard can be canceled at any time.
  • Check: The user can go back to the previous wizard page at any time
  • Check: The wizard can be finished after filling the project name and specifying a device.

New Java ME MIDlet Wizard

    • Check: Can create a new MIDlet
    • Check: Can create a new MIDlet automatically adding it to the Application Descriptor
    • Check: Can create a new MIDlet without adding it to the Application Descriptor
    • Check: Can create a new MIDlet changing other settings
    • Check: Cannot create a new MIDlet with a previously existing MIDlet name in the same project/package.

Project Properties

  • Check: "Mobile Tools for Java" category exists
  • Check: Can manage project configurations (If active configuration switched, the change must reflect on project's "Java ME Library")
  • Check: Can change JAD file name
  • Check: Can change JAR file name
  • Library
    • Check: Can select a library
    • Check: Can deselect a library
    • Check: Can view the details of a library
    • Check: The Sample library is available to be selected
    • Check: All libraries that use properly the Extension Point available in org.eclipse.mtj.core.library Plug-in are available to be selected
  • MIDlet Suite Signing
    • Check: Can configure signing settings
    • Check: If correctly configured the MIDlet project must be correctly signed
  • Obfuscation
    • Check: If "Enable project specific settings" is enabled, these settings must override the default configuration
    • Check: Can configure obfuscation settings
  • Packaging
    • Check: If "Enable project specific settings" is enabled, these settings must override the default configuration
    • Check: Can configure packaging settings
  • Preverification
    • Check: If "Enable project specific settings" is enabled, these settings must override the default configuration
    • Check: Can configure preverification settings

Jad Editor

  • Check: Any property edited by the Jad Editor must be updated in the <project_jad_file>.jad
    • Overview Page
      • Check: Can manage configurations on Runtime section.
    • Required Properties Page
    • MIDlets Page
    • Optional Properties Page
    • Over the Air Properties Page
    • Push Registry Page
    • Used Defined Properties Page

Localization Data Editor

  • *If the Localization is enabled.
  • Check: Is possible to configure the Localization Data on the xml file.
  • Check: Is possible to configure the Localization Data using the Localization Data Editor.
  • Check: Is possible to configure the Localization Data on the generated classes (L10nConstants.java and L10nResources.java).
  • Check: Is possible to configure the Localization Data on the generated properties file (one file for each locale).
  • Check: Any property edited on the Localization Data must be updated in all places that the information is displayed (xml file, generated classes, properties file and Localization Data Editor).

Java Editor

  • Library
    • Check: Classes with NON_ACCESSIBLE access rule* of selected libraries can not be used
    • Check: Classes with DISCOURAGED access rule* of selected libraries can be used but a warning must appear
    • Check: Classes with ACCESSIBLE access rule* of selected libraries can be used
    • Check: Classes with no access rule* of selected libraries can be used
    • Check: Libraries that were not selected can not be used
    • * The Access Rules are defined in the plugin.xml file

Project's Context Sensitive Menu

  • MIDlet Project
    • Check: Can create package
    • Check: If "Proguard" is correctly configured, can create obfuscated package
    • Check: If "Antenna" is correctly configured, can export Antenna build files.
  • Regular Java Project/Other Project
    • Check: Can convert to MIDlet Project

Run/Debug Dialog

  • MIDlet tab
    • Check: Can change project
    • Check: Can run a MIDlet specifying the MIDlet class
    • Check: Can run a MIDlet Suite specifying the JAD URL
    • Check: Can run a MIDlet Suite emulating "Over the Air" deployment
  • Emulation tab
    • Check: Can set a specific device to run/debug
    • Check: If "Specific Device" is selected, can manage devices

Localization Support

  • Add Localization Option
    • Check: Select the MIDlet project pop up menu and verify if the "Add Internationalization" option inside the "Mobile Tools for Java" sub menu is shown
    • Check: Select the "Add Internationalization" option and verify if the Localization Wizard is shown
  • Localization Wizard
    • Check: Verify that the "Finish" button is disabled
    • Select: Browse for a folder where the properties files will be saved
    • Check: Verify that the "Finish" button is still disabled
    • Select: Browse for a package where the Localization API classes will be saved
    • Check: Verify that the "Finish" button is enabled
    • Select: Press "Finish" button
    • Check: Check that the I18nResources.java source file is stored at the package previously selected
    • Check: Repeate all steps above and press "Cancel" button
    • Check: No changes must be made to the project

User and Legal Documentation

Verify User Docs

  • Walk through tutorial, Context Help, Check Links, Search feature

Verify Legal

  • Feature Descriptions, Licenses in all source features, Overall license