Difference between revisions of "TM 2.0 M6 Testing"

Latest revision as of 04:27, 23 April 2007

Nav: DSDP/TM | DSDP/TM/Testing | TM 2.0 Testing | TM 2.0 M6 Testing | TM 2.0 Test Instructions | TM 2.0 Known Issues and Workarounds | TM Manual Test Plan

This is the master coordination page for TM 2.0 M6 Testing, to be done with Target Management 2.0 M6, 3-Apr-2007. Please sign up here for testing particular features of TM 2.0 M6, or a particular host / target combination. It is important for all of us to coordinate our efforts

• In order to get bugs submitted early, such that we can fix them for the release
• In order to avoid duplication of testing work
• In order to get a good test coverage and exposure of TM / RSE.

Organization and Signup

The main focus in this round of testing is to find obvious showstoppers, and to verify the integration into the Europa Coordinated Update Site (Note: we need to use the Staging site for testing, see below).

Most of you took part in an earlier round of testing already, so you'll not need to read all of the TM 2.0 Test Instructions. Here is some important information for this round of testing:

• Please use a customized bug entry template again. If you already have one from an earlier round of testing, change "2.0M5 Testing" into "2.0M6 Testing" and save it as your new bookmark for this round of testing. Otherwise, use this link to show, modify and save a sample bug entry template.
• If possible, please use the JDK versions as signed up in the table below. These are chosen to comply with our Reference Platforms and JDK versions. Edit the table below if you need to use a different JDK version.
• Downloads to test are at I20070406-0930
  • Official Test Platform is Eclipse 3.3M6 (with use CDT 4.0.0M6 for remotecdt and EMF 2.3.0M6 for discovery if you want to test those).
  • Eclipse 3.2 has problems displaying Property Pages for subsystems so we do not support it.
  • Some scripts that make the job of downloading RSE easier have been published on the mailing list.
• Updates Site to test is at http://download.eclipse.org/dsdp/tm/testUpdates
  • Europa Integration Site will be at http://download.eclipse.org/releases/europa/staging (we are not integrated yet)
• Known issues are at TM 2.0 Known Issues and Workarounds
  • Currently open major, critical, blocker issues
  • Currently open bugs assigned to M6
  • Currently open bugs detected during testing
• Components affected by fixes for I20070406-0930:
  • Filters 181394 filter shows data from wrong connection
  • EFS 180091 Use handles to fix EFS project on workbench startup; 177323 No query from EFS on workbench shutdown; 180874 Progress monitor for Create Remote Project; 170916 get rid of separate EFS feature
  • Update Site 175341[nls] Add NLS strings for tmMilestoneUpdateSite in features
• Components affected by fixes for I20070405-1810:
  • Copy&Paste 181197 avoid empty list after copy remote -> local
  • Remote Browse Dialog 181222 prevent null set on SaveAsForm; 181222 for SystemResoruceSelectionInputProvider (used by file dialog) the initial connection should be set;
  • API 180602 [api] Remove remaining messages for Communications Daemon; 1590939 added readOnly attribute to IProperty; [cleanup] make IRSEDOMExporter & IRSEDOMImporter internal, add package.html;
• Components affected by fixes for I20070405-1200:
  • SSH, Update Site 175686 Get rid of Platform CVS Dependency;
  • Persistence 177882 Fixed PropertyFileProvider for garbling of CJK characters
  • Dstore Persistence 181069 getContextString() for saving shell states;
  • API 179184 changed preference name to DEFAULT_PERSISTENCE_PROVIDER;
• Components affected by fixes for I20070405-0600:
  • Dstore Reconnect [1] clean up environment miner variables
  • Dstore Shell [2] asynch exec job to avoid endless looping of dstore shell
  • API [3][api] Default Persistence Provider Preference; [4] make test scripting internal; [5] deprecating getVendorAttributes and setVendorAttributes; [6][api] added setDescription() method
• Components affected by fixes for I20070405-0600:
  • FTP Download [7][ftp] copying files in multiple threads
  • Subsystem Properties [8] fix dstore subsystem property pages and discovery.edit/plugin.xml
  • System Connect Form/Combo [fix] getHostNames() return String[] containing invalid null values
• Components affected by fixes for I20070404-1200:
  • Everything [9][api] IHost.getSystemType() should return IRSESystemType;
  • dstore [10] moved dstore.miners.miner to dstore.miners;
  • Persistence [11][api] refactoring and adding new tracking api for persistence;
  • EFS [12] New files could not be created in EFS due to thread blocking

• You'll have two tasks for testing this time:
  • 1. Sanity check - please use RSE in a "normal" way as you'd usually use it. RSE 1.0 Test Instructions have a sample sanity check. Please test on your assigned host/target combination. Report any bad behavior. We should try to get most of RSE covered since refactorings might have broken things.
  • 2. Bug verification - See the P1, P2, Critical and Major bugs modified query for verification candidates. I'm not splitting up the bugs to be verified, please take from the query mentioned what you think you can verify; naturally, those reported by yourself are the prime candidates. Change the status soon and refresh the query often to ensure we don't do duplicate work. When you verified a bug OK, set it to VERIFIED. Bugzilla allows you to click on the "next bug" link so you'll be able to move through the list quite quickly.

Thanks to everybody who signs up and thus helps making RSE better!

Test Matrix

Test Features

RSE Features signed up already

• MartinO:
  • MV Shell Processes Subsystem
  • Terminal (ssh,telnet,serial)
  • Shell Content Assist-Linux (local,ssh,dstore)
  • Shell Content Assist-Windows (local,dstore)
  • Shell Pattern Matching (Compiler Error Navigation, Directory and File Navigation)
• DaveD:
  • Basic Sanity Test (of course)
  • Subsystem properties
  • RSE Views
  • Connection problems
  • Preferences

RSE Features that are particularly important to test

• Verifications: 2.0M6 Bugs (by date) fixed but not yet verified

• Basic Sanity Test (File Subsystem, dirlist, simple filters, upload/download/edit, Tableview)
• File Encodings (Foreign language files on remote side)
• CDT Remote Launch
• Drag&Drop, Copy&Paste (RSE <-> RSE, Eclipse Navigator, Windows Explorer, Overwrite vs. Rename)
• Discovery
• EFS

RSE Features to test

• Dstore Launch Options (Rlogin, Already-Running, Port Ranges, SSL Connection)
• Parallel access (multiple parallel actions)
• Update Site: Install & Upgrade via Update Site
• Scalability (Really large file lists, lots of events)
• Processes Subsystem (List, Sort, Kill, Remote Monitor)
• Verify Extension Points (Check docs, use in own code)
• Remote Search (dstore only)
• Complex Filters (Multiple filter strings, Filter by filetype, Filter Persistence...)
• Preferences (Walk through each of the Preferences and enable/disable)
• Subsystem Properties (Changing Properties of Systems/Subsystems in the RSE Tree)
• Synchronous operation (Do a sanity check with "Deferred Queries" switched off in Preferences)
• Dirty Editors and Merging (Editing a Remote File that also changes remotely)
• File Access Permissions and Timestamps (Read-only files etc.)
• RSE Views: Treeview, Tableview, Monitor, Properties, Scratchpad, Editor, Compare (Check for consistency)
• RSE Widgets & Dialogs: Remote file-browse, Remote move-to
• Connection Problems (Very slow connections, unavailable/unreliable hosts, timeouts, breaking connections)

Features not to be tested this time

• Team Support (Share connections, Connection Profiles)
• Verify Copyright and Externalized Strings (Run automated checks, chkpii)
• Verify Legal (Feature Descriptions, Licenses in all source features, Overall license)
• Verify User Docs (Walk through tutorial, Context Help, Check Links, Search feature)
• Verify ISV Tutorial (Walk through ISV tutorial)
• Verify ISV Docs (Broken Links, Semantic correctness, Searchable docs, Useful Javadoc)

Client Platforms

Target Platforms

Test Reports and Bugs Found

• Test Candidates:
  • P1, P2, Critical and Major bugs modified during the test period but not yet verified
  • 2.0M6 Bugs (by date) fixed but not yet verified

• Test Results:
  • New bugs opened during test period
  • Bugs reopened during test period
  • Bugs verified or closed during test period

• Internal Reports:
  • Bugzilla report: Reporter X Severity by date, reported during test period (2007-04-03 - 2007-04-08)
  • Bugzilla report: Reporter X Fix status by date, for bugs reported during test period (2007-04-03 - 2007-04-08)
  • Bugs fixed for 2.0M6 by date including verified and closed
  • Bugs fixed for 2.0M6 by target milestone