Difference between revisions of "TM 2.0 M6 Testing"

Revision as of 09:36, 3 April 2007

Nav: DSDP/TM | TM 2.0 Testing | TM 2.0 M6 Testing | TM 2.0 Test Instructions | TM 2.0 Known Issues and Workarounds | TM Manual Test Plan

This is the master coordination page for TM 2.0 M6 Testing, to be done with Target Management 2.0 M6, 3-Apr-2007. Please sign up here for testing particular features of TM 2.0 M6, or a particular host / target combination. It is important for all of us to coordinate our efforts

• In order to get bugs submitted early, such that we can fix them for the release
• In order to avoid duplication of testing work
• In order to get a good test coverage and exposure of TM / RSE.

Organization and Signup

The main focus in this round of testing is to find obvious showstoppers, and to verify the integration into the Europa Coordinated Update Site (Note: we need to use the Staging site for testing, see below).

Most of you took part in an earlier round of testing already, so you'll not need to read all of the TM 2.0 Test Instructions. Here is some important information for this round of testing:

• Please use a customized bug entry template again. If you already have one from an earlier round of testing, change "2.0M5 Testing" into "2.0M6 Testing" and save it as your new bookmark for this round of testing. Otherwise, use this link to show, modify and save a sample bug entry template.
• If possible, please use the JDK versions as signed up in the table below. These are chosen to comply with our Reference Platforms and JDK versions. Edit the table below if you need to use a different JDK version.
• Downloads to test are at I20070403-0600
  • Official Test Platform is Eclipse 3.3M6 (with use CDT 4.0.0M6 for remotecdt and EMF 2.3.0M6 for discovery if you want to test those).
  • Eclipse 3.2 has problems displaying Property Pages for subsystems so we do not support it.
• Updates Site to test is at http://download.eclipse.org/dsdp/tm/testUpdates
  • Europa Integration Site will be at http://download.eclipse.org/releases/europa/staging (we are not integrated yet)
• Known issues are at TM 2.0 Known Issues and Workarounds
• Components affected by fixes since the previous test candidate I20070221-1831:
  • New Discovery:
  • Drag&Drop, Copy&Paste:
  • Pretty much everything due to heavy refactorings

• You'll have two tasks for testing this time:
  • 1. Sanity check - please use RSE in a "normal" way as you'd usually use it. RSE 1.0 Test Instructions have a sample sanity check. Please test on your assigned host/target combination. Report any bad behavior. We should try to get most of RSE covered since refactorings might have broken things.
  • 2. Bug verification - See the P1, P2, Critical and Major bugs modified query for verification candidates. I'm not splitting up the bugs to be verified, please take from the query mentioned what you think you can verify; naturally, those reported by yourself are the prime candidates. Change the status soon and refresh the query often to ensure we don't do duplicate work. When you verified a bug OK, set it to VERIFIED. Bugzilla allows you to click on the "next bug" link so you'll be able to move through the list quite quickly.

Thanks to everybody who signs up and thus helps making RSE better!

Test Matrix

Test Features

RSE Features signed up already

• MartinO:
  • MV Shell Processes Subsystem
  • Terminal (ssh,telnet,serial)
  • Shell Content Assist-Linux (local,ssh,dstore)
  • Shell Content Assist-Windows (local,dstore)
  • Shell Pattern Matching (Compiler Error Navigation, Directory and File Navigation)

RSE Features that are particularly important to test

• Verifications: 2.0M6 Bugs (by date) fixed but not yet verified

• Basic Sanity Test (File Subsystem, dirlist, simple filters, upload/download/edit, Tableview)
• File Encodings (Foreign language files on remote side)
• CDT Remote Launch
• Drag&Drop, Copy&Paste (RSE <-> RSE, Eclipse Navigator, Windows Explorer, Overwrite vs. Rename)
• Discovery
• EFS

RSE Features to test

• Dstore Launch Options (Rlogin, Already-Running, Port Ranges, SSL Connection)
• Parallel access (multiple parallel actions)
• Update Site: Install & Upgrade via Update Site
• Scalability (Really large file lists, lots of events)
• Processes Subsystem (List, Sort, Kill, Remote Monitor)
• Verify Extension Points (Check docs, use in own code)
• Remote Search (dstore only)
• Complex Filters (Multiple filter strings, Filter by filetype, Filter Persistence...)
• Preferences (Walk through each of the Preferences and enable/disable)
• Subsystem Properties (Changing Properties of Systems/Subsystems in the RSE Tree)
• Synchronous operation (Do a sanity check with "Deferred Queries" switched off in Preferences)
• Dirty Editors and Merging (Editing a Remote File that also changes remotely)
• File Access Permissions and Timestamps (Read-only files etc.)
• RSE Views: Treeview, Tableview, Monitor, Properties, Scratchpad, Editor, Compare (Check for consistency)
• RSE Widgets & Dialogs: Remote file-browse, Remote move-to
• Connection Problems (Very slow connections, unavailable/unreliable hosts, timeouts, breaking connections)

Features not to be tested this time

• Team Support (Share connections, Connection Profiles)
• Verify Copyright and Externalized Strings (Run automated checks, chkpii)
• Verify Legal (Feature Descriptions, Licenses in all source features, Overall license)
• Verify User Docs (Walk through tutorial, Context Help, Check Links, Search feature)
• Verify ISV Tutorial (Walk through ISV tutorial)
• Verify ISV Docs (Broken Links, Semantic correctness, Searchable docs, Useful Javadoc)

Client Platforms

Target Platforms

Test Reports and Bugs Found

• Test Candidates:
  • P1, P2, Critical and Major bugs modified during the test period but not yet verified
  • 2.0M6 Bugs (by date) fixed but not yet verified

• Test Results:
  • New bugs opened during test period
  • Bugs reopened during test period
  • Bugs verified or closed during test period

• Internal Reports:
  • Bugzilla report: Reporter X Severity by date, reported during test period (2007-04-03 - 2007-04-08)
  • Bugzilla report: Reporter X Fix status by date, for bugs reported during test period (2007-04-03 - 2007-04-08)
  • Bugs fixed for 2.0M6 by date including verified and closed
  • Bugs fixed for 2.0M6 by target milestone