Jump to: navigation, search

DSDP/MTJ/Tests/Manual

< DSDP‎ | MTJ‎ | Tests
Revision as of 05:19, 20 November 2008 by Feng.wang.sybase.com (Talk | contribs)

This is the MTJ Manual Test Plan. Tasks are outlined very briefly only. Feel free to do some exploratory testing around the suggested items, or suggest new test cases.

Standard usability tests

When testing, make sure that the settings changed were correctly applied, producing the expected behavior. E.g. If you select an specific device to run a MIDlet in a run dialog, make sure that you run the MIDlet and the device running is the selected one.

Preferences Pages

  • Walk through all of the preferences items in "Mobile Tools for Java" category and change their values
    • Check: The outcome is what you expect?
    • Check: Are the Preferences documented sufficiently?
    • Check: The preferences can be restored to default values?
Device Management Page
  • Check: Can import Devices
  • Check: Can edit Devices
  • Check: Can delete Devices
  • Check: Can duplicate Devices
New MIDlet Project Page
  • Resource folder field
    • Check: Can specify a resource folder name
    • Check: If you specify a folder name, the next project you create uses it as resource folder?
Over the Air Page
  • Check: Can change settings and the changes work as expected?
Packaging Page
  • Check: Can add/remove "Excluded Manifest Entries"
Obfuscation Page
  • Check: Can configure Proguard settings
Preverification Page
  • Check: "Use Built-in preverifier" can't be selected

Import Device Wizard

  • Check: The Finish button is disabled before finding a device?
  • Check: The Select All and Deselect All buttons are disabled before finding a device?
  • Check: The Refresh button is disabled before specifying the search directory?
  • Check: Choosing a folder without any device inside and pressing Refresh will result in no devices found (the device list will remain empty)
  • Check: Choosing a folder with devices inside and pressing Refresh will result in the device list filled with the devices found
  • Check: Pressing Finish button after finding at least one device, will add the device list to the Device Management Page

Device Editor

  • Basic Page
  • Libraries Page
    • Check: can add and remove libraries
    • Check: can define javadoc for library
    • Check: can define source for library
  • Properties Page
    • Check: Can not edit, add or remove properties.

MIDlet Project

New MIDlet Project Wizard

  • Check: "Mobile Tools for Java" category exists
  • "Mobile Tools for Java" Category
    • Check: MIDlet Project in category
  • MIDlet Suite Properties
    • Check: Can manage Devices
    • Check: Can change Application descriptor name
    • Check: The Next and Finish buttons must be disabled in invalid scenarios, such as:
  1. A configuration is added and Application descriptor field is empty
  2. A configuration is added but Application descriptor field has an invalid value (i.e. something.txt)
  3. No configuration is added and Application descriptor field is empty
  4. No configuration is added and Application descriptor field has valid value (i.e. something.jad)
    • Check: When one or more configuration is added and Application descriptor field has valid value (i.e. something.jad) the Next and Finish buttons must be enabled
  • Java settings
    • Check: Can edit Java settings
    • Libraries Tab
      • Check: "Java ME Library" corresponds to the device selected in previous page.
      • Check: If another device is selected, the change is reflected in "Java ME Library"
  • Check: The wizard can be canceled at any time.
  • Check: The user can go back to the previous wizard page at any time
  • Check: The wizard can be finished after filling the project name and specifying a device.

New Java ME MIDlet Wizard

    • Check: Can create a new MIDlet
    • Check: Can create a new MIDlet automatically adding it to the Application Descriptor
    • Check: Can create a new MIDlet without adding it to the Application Descriptor
    • Check: Can create a new MIDlet changing other settings
    • Check: Cannot create a new MIDlet with a previously existing MIDlet name in the same project/package.

Project Properties

  • Check: "Mobile Tools for Java" category exists
  • Check: Can manage project configurations (If active configuration switched, the change must reflect on project's "Java ME Library")
  • Check: Can change JAD file name
  • Check: Can change JAR file name
  • MIDlet Suite Signing
    • Check: Can configure signing settings
    • Check: If correctly configured the MIDlet project must be correctly signed
  • Obfuscation
    • Check: If "Enable project specific settings" is enabled, these settings must override the default configuration
    • Check: Can configure obfuscation settings
  • Packaging
    • Check: If "Enable project specific settings" is enabled, these settings must override the default configuration
    • Check: Can configure packaging settings
  • Preverification
    • Check: If "Enable project specific settings" is enabled, these settings must override the default configuration
    • Check: Can configure preverification settings

Jad Editor

  • Check: Any property edited by the Jad Editor must be updated in the <project_jad_file>.jad
    • Required Properties Page
    • MIDlets Page
    • Optional Properties Page
    • Over the Air Properties Page
    • Push Registry Page
    • Used Defined Properties Page

Project's Context Sensitive Menu

  • MIDlet Project
    • Check: Can create package
    • Check: If "Proguard" is correctly configured, can create obfuscated package
    • Check: If "Antenna" is correctly configured, can export Antenna build files.
  • Regular Java Project/Other Project
    • Check: Can convert to MIDlet Project

Run/Debug Dialog

  • MIDlet tab
    • Check: Can change project
    • Check: Can run a MIDlet specifying the MIDlet class
    • Check: Can run a MIDlet Suite specifying the JAD URL
    • Check: Can run a MIDlet Suite emulating "Over the Air" deployment
  • Emulation tab
    • Check: Can set a specific device to run/debug
    • Check: If "Specific Device" is selected, can manage devices

User and Legal Documentation

Verify User Docs

  • Walk through tutorial, Context Help, Check Links, Search feature

Verify Legal

  • Feature Descriptions, Licenses in all source features, Overall license