Difference between revisions of "TM 2.0.1 Testing"

Revision as of 09:42, 10 September 2007

Nav: DSDP/TM | DSDP/TM/Testing | TM 2.0.1 Testing | TM 2.0 Test Instructions | TM 2.0 Known Issues and Workarounds | TM Manual Test Plan

This is the master coordination page for TM 2.0.1 Testing, to be done with Target Management 2.0.1 RC3, 13-Sep-2007. Please sign up here for testing particular features of TM 2.0.1, or a particular host / target combination. It is important for all of us to coordinate our efforts

• In order to get bugs submitted early, such that we can fix them for the release
• In order to avoid duplication of testing work
• In order to get a good test coverage and exposure of TM / RSE.

Organization and Signup

The main focus in this round of testing is to find regressions, obvious showstoppers, and to verify the bug fixes made for TM 2.0.1. Please take the list below and focus on the high-severity / high-priority bugs first. Check the list often in order to avoid multiple people verifying the same bugs.

• Bugs fixed for 2.0.1 but not yet verified

Most of you took part in an earlier round of testing already, so you'll not need to read all of the TM 2.0 Test Instructions. Here is some important information for this round of testing:

• Please use a customized bug entry template again. If you already have one from an earlier round of testing, change "2.0M7 Testing" into "2.0.1 Testing" and save it as your new bookmark for this round of testing. Otherwise, use this link to show, modify and save a sample bug entry template.
• If possible, please use the JDK versions as signed up in the table below. These are chosen to comply with our Reference Platforms and JDK versions. Edit the table below if you need to use a different JDK version.
• Downloads to test are at the TM download page
  • Official Test Platform is Eclipse Europa.
  • Some scripts that make the job of downloading RSE easier have been published on the mailing list.
• Updates Site to test is at http://download.eclipse.org/dsdp/tm/testUpdates
  • Europa Integration Site will be at http://download.eclipse.org/releases/europa/staging
• Known issues are at TM 2.0 Known Issues and Workarounds
  • Currently open major, critical, blocker issues
  • Currently open bugs assigned to 2.0.1
  • Currently open bugs detected during testing

• You'll have two tasks for testing this time:
  • 1. Sanity check - please use RSE in a "normal" way as you'd usually use it. RSE 1.0 Test Instructions have a sample sanity check. Please test on your assigned host/target combination. Report any bad behavior. We should try to get most of RSE covered since refactorings might have broken things.
  • 2. Bug verification - See the P1, P2, Critical and Major bugs modified query for verification candidates. I'm not splitting up the bugs to be verified, please take from the query mentioned what you think you can verify; naturally, those reported by yourself are the prime candidates. Change the status soon and refresh the query often to ensure we don't do duplicate work. When you verified a bug OK, set it to VERIFIED. Bugzilla allows you to click on the "next bug" link so you'll be able to move through the list quite quickly.

Thanks to everybody who signs up and thus helps making RSE better!

Test Matrix

Test Features

RSE Features signed up already

• MartinO:
  • Terminal (ssh,telnet,serial)
• DaveD:
  • Basic Sanity Test (of course)
  • Subsystem properties
  • RSE Views
  • Connection problems
  • Preferences

RSE Features that are particularly important to test

• Verifications: 2.0.1 Bugs (by date) fixed but not yet verified

• Basic Sanity Test (File Subsystem, dirlist, simple filters, upload/download/edit, Tableview)
• File Encodings (Foreign language files on remote side)
• CDT Remote Launch
• Drag&Drop, Copy&Paste (RSE <-> RSE, Eclipse Navigator, Windows Explorer, Overwrite vs. Rename)
• Discovery
• EFS

RSE Features to test

• Dstore Launch Options (Rlogin, Already-Running, Port Ranges, SSL Connection)
• Parallel access (multiple parallel actions)
• Update Site: Install & Upgrade via Update Site
• Scalability (Really large file lists, lots of events)
• Processes Subsystem (List, Sort, Kill, Remote Monitor)
  • MV Shell Processes Subsystem
• Verify Extension Points (Check docs, use in own code)
• Remote Search (dstore only)
• Complex Filters (Multiple filter strings, Filter by filetype, Filter Persistence...)
• Preferences (Walk through each of the Preferences and enable/disable)
• Subsystem Properties (Changing Properties of Systems/Subsystems in the RSE Tree)
• Synchronous operation (Do a sanity check with "Deferred Queries" switched off in Preferences)
• Dirty Editors and Merging (Editing a Remote File that also changes remotely)
• File Access Permissions and Timestamps (Read-only files etc.)
• RSE Views: Treeview, Tableview, Monitor, Properties, Scratchpad, Editor, Compare (Check for consistency)
• RSE Widgets & Dialogs: Remote file-browse, Remote move-to
• Connection Problems (Very slow connections, unavailable/unreliable hosts, timeouts, breaking connections)

Features not to be tested this time

• Team Support (Share connections, Connection Profiles)
• Verify Copyright and Externalized Strings (Run automated checks, chkpii)
• Verify Legal (Feature Descriptions, Licenses in all source features, Overall license)
• Verify User Docs (Walk through tutorial, Context Help, Check Links, Search feature)
• Verify ISV Tutorial (Walk through ISV tutorial)
• Verify ISV Docs (Broken Links, Semantic correctness, Searchable docs, Useful Javadoc)
• Shell Content Assist-Linux (local,ssh,dstore)
• Shell Content Assist-Windows (local,dstore)
• Shell Pattern Matching (Compiler Error Navigation, Directory and File Navigation)

Client Platforms

Target Platforms

Test Reports and Bugs Found

• Test Candidates:
  • P1, P2, Critical and Major bugs modified during the test period but not yet verified
  • 2.0.1 Bugs (by date) fixed but not yet verified

• Test Results:
  • New bugs opened during test period
  • Bugs reopened during test period
  • Bugs verified or closed during test period

• Internal Reports:
  • Bugzilla report: Reporter X Severity by date, reported during test period (2007-09-13 - 2007-09-15)
  • Bugzilla report: Reporter X Fix status by date, for bugs reported during test period (2007-09-13 - 2007-09-15)
  • Bugs fixed for 2.0.1 by date including verified and closed
  • Bugs fixed for 2.0.1 by target milestone