Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "TM 2.0 M6 Testing"
Line 17: | Line 17: | ||
* Please use a customized bug entry template again. If you already have one from an earlier round of testing, change "2.0M5 Testing" into "2.0M6 Testing" and save it as your new bookmark for this round of testing. Otherwise, use [https://bugs.eclipse.org/bugs/enter_bug.cgi?product=Target%20Management&version=2.0&component=RSE&comment=%0D%0A-----------Enter%20bugs%20above%20this%20line-----------%0D%0ATM%202.0M6%20Testing%0D%0Ainstallation%20%3A%20eclipse-platform-3.3M6%20%28I200703__-____%29%2C%20cdt-4.0M6%2C%20emf-2.3M6%0D%0ARSE%20install%20%20%3A%20update-site%20RSE-runtime-all%20%2B%20discovery%20%2B%20efs%0D%0Ajava.runtime%20%3A%20Sun%201.5.0_11-b03%0D%0Aos.name%3A%20%20%20%20%20%3A%20Windows%20XP%205.1%2C%20Service%20Pack%202%0D%0A------------------------------------------------%0D%0Asystemtype%20%20%20%3A%20Unix-ssh%20%28dstore-processes%29%0D%0Atargetos%20%20%20%20%20%3A%20SUSE%20LINUX%2010.1%20%28i586%29%0D%0Atargetuname%20%20%3A%20Linux%20osgiliath%202.6.16.21-0.21-default%20%231%20Tue%20Aug%2029%2016%3A42%3A05%20UTC%202006%20i686%20athlon%20i386%20GNU%2FLinux%0D%0Atargetvm%20%20%20%20%20%3A%20Sun%20Java%20HotSpot%28TM%29%20Client%20VM%20%28build%201.5.0_07-b03%2C%20mixed%20mode%2C%20sharing%29%0D%0A------------------------------------------------%0D%0A&form_name=enter_bug this link to show, modify and save a sample bug entry template]. | * Please use a customized bug entry template again. If you already have one from an earlier round of testing, change "2.0M5 Testing" into "2.0M6 Testing" and save it as your new bookmark for this round of testing. Otherwise, use [https://bugs.eclipse.org/bugs/enter_bug.cgi?product=Target%20Management&version=2.0&component=RSE&comment=%0D%0A-----------Enter%20bugs%20above%20this%20line-----------%0D%0ATM%202.0M6%20Testing%0D%0Ainstallation%20%3A%20eclipse-platform-3.3M6%20%28I200703__-____%29%2C%20cdt-4.0M6%2C%20emf-2.3M6%0D%0ARSE%20install%20%20%3A%20update-site%20RSE-runtime-all%20%2B%20discovery%20%2B%20efs%0D%0Ajava.runtime%20%3A%20Sun%201.5.0_11-b03%0D%0Aos.name%3A%20%20%20%20%20%3A%20Windows%20XP%205.1%2C%20Service%20Pack%202%0D%0A------------------------------------------------%0D%0Asystemtype%20%20%20%3A%20Unix-ssh%20%28dstore-processes%29%0D%0Atargetos%20%20%20%20%20%3A%20SUSE%20LINUX%2010.1%20%28i586%29%0D%0Atargetuname%20%20%3A%20Linux%20osgiliath%202.6.16.21-0.21-default%20%231%20Tue%20Aug%2029%2016%3A42%3A05%20UTC%202006%20i686%20athlon%20i386%20GNU%2FLinux%0D%0Atargetvm%20%20%20%20%20%3A%20Sun%20Java%20HotSpot%28TM%29%20Client%20VM%20%28build%201.5.0_07-b03%2C%20mixed%20mode%2C%20sharing%29%0D%0A------------------------------------------------%0D%0A&form_name=enter_bug this link to show, modify and save a sample bug entry template]. | ||
* If possible, please use the JDK versions as signed up in the table below. These are chosen to comply with our [http://www.eclipse.org/dsdp/tm/development/plan.php#OperatingEnvironments Reference Platforms and JDK versions]. Edit the table below if you need to use a different JDK version. | * If possible, please use the JDK versions as signed up in the table below. These are chosen to comply with our [http://www.eclipse.org/dsdp/tm/development/plan.php#OperatingEnvironments Reference Platforms and JDK versions]. Edit the table below if you need to use a different JDK version. | ||
− | * Downloads to test are at [http://download.eclipse.org/dsdp/tm/downloads/drops/I20070405- | + | * Downloads to test are at [http://download.eclipse.org/dsdp/tm/downloads/drops/I20070405-1200 I20070405-1200] |
** Official Test Platform is '''[http://download.eclipse.org/eclipse/downloads/drops/S-3.3M6-200703231616/index.php Eclipse 3.3M6]''' (with use [http://download.eclipse.org/tools/cdt/releases/europa/dist/4.0.0M6 CDT 4.0.0M6] for remotecdt and [http://download.eclipse.org/modeling/emf/emf/downloads/drops/2.3.0/S200703291501 EMF 2.3.0M6] for discovery if you want to test those). | ** Official Test Platform is '''[http://download.eclipse.org/eclipse/downloads/drops/S-3.3M6-200703231616/index.php Eclipse 3.3M6]''' (with use [http://download.eclipse.org/tools/cdt/releases/europa/dist/4.0.0M6 CDT 4.0.0M6] for remotecdt and [http://download.eclipse.org/modeling/emf/emf/downloads/drops/2.3.0/S200703291501 EMF 2.3.0M6] for discovery if you want to test those). | ||
** Eclipse 3.2 has problems displaying Property Pages for subsystems so we '''do not support it'''. | ** Eclipse 3.2 has problems displaying Property Pages for subsystems so we '''do not support it'''. | ||
Line 27: | Line 27: | ||
** Currently open [https://bugs.eclipse.org/bugs/report.cgi?x_axis_field=target_milestone&y_axis_field=assigned_to&query_format=report-table&classification=DSDP&product=Target+Management&target_milestone=2.0+M6&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&format=table&action=wrap bugs assigned to M6] | ** Currently open [https://bugs.eclipse.org/bugs/report.cgi?x_axis_field=target_milestone&y_axis_field=assigned_to&query_format=report-table&classification=DSDP&product=Target+Management&target_milestone=2.0+M6&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&format=table&action=wrap bugs assigned to M6] | ||
** Currently open [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&classification=DSDP&product=Target+Management&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&chfieldfrom=2007-04-03&chfieldto=2007-04-08&chfield=%5BBug+creation%5D&cmdtype=doit bugs detected during testing] | ** Currently open [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&classification=DSDP&product=Target+Management&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&chfieldfrom=2007-04-03&chfieldto=2007-04-08&chfield=%5BBug+creation%5D&cmdtype=doit bugs detected during testing] | ||
+ | * Components affected by fixes since the previous test candidate [http://download.eclipse.org/dsdp/tm/downloads/drops/I20070404-0600 I20070405-0600]: | ||
+ | ** '''SSH, Update Site''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=175686 175686] Get rid of Platform CVS Dependency; | ||
+ | ** '''Persistence''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=177882 177882] Fixed PropertyFileProvider for garbling of CJK characters | ||
+ | ** '''Dstore Persistence''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=181069 181069] getContextString() for saving shell states; | ||
+ | ** '''API''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=179184 179184] changed preference name to DEFAULT_PERSISTENCE_PROVIDER; | ||
* Components affected by fixes since the previous test candidate [http://download.eclipse.org/dsdp/tm/downloads/drops/I20070404-0600 I20070404-1200]: | * Components affected by fixes since the previous test candidate [http://download.eclipse.org/dsdp/tm/downloads/drops/I20070404-0600 I20070404-1200]: | ||
− | |||
** '''Dstore Reconnect''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=180994] clean up environment miner variables | ** '''Dstore Reconnect''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=180994] clean up environment miner variables | ||
** '''Dstore Shell''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=181006] asynch exec job to avoid endless looping of dstore shell | ** '''Dstore Shell''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=181006] asynch exec job to avoid endless looping of dstore shell | ||
Line 35: | Line 39: | ||
** '''FTP Download''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=180711][ftp] copying files in multiple threads | ** '''FTP Download''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=180711][ftp] copying files in multiple threads | ||
** '''Subsystem Properties''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=180933] fix dstore subsystem property pages and discovery.edit/plugin.xml | ** '''Subsystem Properties''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=180933] fix dstore subsystem property pages and discovery.edit/plugin.xml | ||
− | |||
** '''System Connect Form/Combo''' [fix] getHostNames() return String[] containing invalid null values | ** '''System Connect Form/Combo''' [fix] getHostNames() return String[] containing invalid null values | ||
* Components affected by fixes since the previous test candidate [http://download.eclipse.org/dsdp/tm/downloads/drops/I20070403-0600 I20070403-0600]: | * Components affected by fixes since the previous test candidate [http://download.eclipse.org/dsdp/tm/downloads/drops/I20070403-0600 I20070403-0600]: | ||
Line 41: | Line 44: | ||
** '''dstore''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=180650] moved dstore.miners.miner to dstore.miners; | ** '''dstore''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=180650] moved dstore.miners.miner to dstore.miners; | ||
** '''Persistence''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=142806][api] refactoring and adding new tracking api for persistence; | ** '''Persistence''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=142806][api] refactoring and adding new tracking api for persistence; | ||
− | |||
** '''EFS''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170916] New files could not be created in EFS due to thread blocking | ** '''EFS''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170916] New files could not be created in EFS due to thread blocking | ||
Revision as of 12:17, 5 April 2007
Nav: DSDP/TM | TM 2.0 Testing | TM 2.0 M6 Testing | TM 2.0 Test Instructions | TM 2.0 Known Issues and Workarounds | TM Manual Test Plan
This is the master coordination page for TM 2.0 M6 Testing, to be done with Target Management 2.0 M6, 3-Apr-2007. Please sign up here for testing particular features of TM 2.0 M6, or a particular host / target combination. It is important for all of us to coordinate our efforts
- In order to get bugs submitted early, such that we can fix them for the release
- In order to avoid duplication of testing work
- In order to get a good test coverage and exposure of TM / RSE.
Contents
Organization and Signup
The main focus in this round of testing is to find obvious showstoppers, and to verify the integration into the Europa Coordinated Update Site (Note: we need to use the Staging site for testing, see below).
Most of you took part in an earlier round of testing already, so you'll not need to read all of the TM 2.0 Test Instructions. Here is some important information for this round of testing:
- Please use a customized bug entry template again. If you already have one from an earlier round of testing, change "2.0M5 Testing" into "2.0M6 Testing" and save it as your new bookmark for this round of testing. Otherwise, use this link to show, modify and save a sample bug entry template.
- If possible, please use the JDK versions as signed up in the table below. These are chosen to comply with our Reference Platforms and JDK versions. Edit the table below if you need to use a different JDK version.
- Downloads to test are at I20070405-1200
- Official Test Platform is Eclipse 3.3M6 (with use CDT 4.0.0M6 for remotecdt and EMF 2.3.0M6 for discovery if you want to test those).
- Eclipse 3.2 has problems displaying Property Pages for subsystems so we do not support it.
- Some scripts that make the job of downloading RSE easier have been published on the mailing list.
- Updates Site to test is at http://download.eclipse.org/dsdp/tm/testUpdates
- Europa Integration Site will be at http://download.eclipse.org/releases/europa/staging (we are not integrated yet)
- Known issues are at TM 2.0 Known Issues and Workarounds
- Currently open major, critical, blocker issues
- Currently open bugs assigned to M6
- Currently open bugs detected during testing
- Components affected by fixes since the previous test candidate I20070405-0600:
- Components affected by fixes since the previous test candidate I20070404-1200:
- Dstore Reconnect [1] clean up environment miner variables
- Dstore Shell [2] asynch exec job to avoid endless looping of dstore shell
- API [3][api] Default Persistence Provider Preference; [4] make test scripting internal; [5] deprecating getVendorAttributes and setVendorAttributes; [6][api] added setDescription() method
- Components affected by fixes since the previous test candidate I20070404-0600:
- Components affected by fixes since the previous test candidate I20070403-0600:
- You'll have two tasks for testing this time:
- 1. Sanity check - please use RSE in a "normal" way as you'd usually use it. RSE 1.0 Test Instructions have a sample sanity check. Please test on your assigned host/target combination. Report any bad behavior. We should try to get most of RSE covered since refactorings might have broken things.
- 2. Bug verification - See the P1, P2, Critical and Major bugs modified query for verification candidates. I'm not splitting up the bugs to be verified, please take from the query mentioned what you think you can verify; naturally, those reported by yourself are the prime candidates. Change the status soon and refresh the query often to ensure we don't do duplicate work. When you verified a bug OK, set it to VERIFIED. Bugzilla allows you to click on the "next bug" link so you'll be able to move through the list quite quickly.
Thanks to everybody who signs up and thus helps making RSE better!
Test Matrix
ok | Tester Name (Company) | Client Platform | Connection types | RSE Features | Time used, Comments |
ok | Dave Dykstal (IBM) | MacOS X 10.4.8, Sun 1.5.0_06-112 | Dstore-Mac, Dstore-Linux, Dstore-Win | Macintosh related. Team features. Persistence & model features (filters, filter pools, ...) | 4 hours so far. DND now is initiated on Mac, though it doesn't completely work. DaveD bugs |
Dave McKnight (IBM) | Linux-GTK (SLES 9), IBMj 1.4.2 sr3 | Dstore-Windows, FTP | DaveM bugs | ||
Kushal Munir (IBM) | Windows XP SP2, IBMj 5.0 | Dstore-Unix (on AIX) | Drag&Drop, Copy&Paste, New Connection Wizard, Encodings, Dstore Launch Options, File Access Permissions and Timestamps | Kushal bugs | |
ok | Javier Montalvo (Symbian) | WinXP 2002 SP2, Sun 1.5.0_11 | Windows-local, FTP | ftp filters and views; filtetype filters, deep filters, drag&drop, copy&paste (contexts) | Javier bugs |
Martin Oberhuber (Wind River) | WinXP SP1, Sun 1.4.2_14 | Windows-Local, Linux-dstore-rexec, Linux-ssh | Download, Connection Problems, Discovery, Terminal(Telnet,Ssh,Serial), Shells-Contentassist, Shell-Processes | Martin bugs | |
Martin Oberhuber (Wind River) | Linux RHEL4, Sun 1.6.0_01 | Linux-Local, Windows-dstore-daemon, Linux-ssh | Update Site, Connection Problems, Discovery, Terminal(Telnet,Ssh,Serial), Shells-Contentassist, Shell-Processes | Martin bugs | |
Tobias Schwarz (Wind River) | WinXP SP2, Sun 1.5.0_11 | Windows-Local, Testsubsys | Verify Tobias reported bugs; ; Filtering, Extension Points | Tobias bugs | |
Uwe Stieber (Wind River) | openSUSE 10.2 (x86-64), Sun 1.5.0_10 (64Bit) | Linux-Local, Testsubsys | Verify Uwe reported bugs; Extension Points | Uwe bugs | |
Lothar Werzinger (Tradescape) | Linux Kubuntu 6.06 x64 GTK, Sun 1.5.0_06 | Linux-ssh, Windows-dstore | ssh filters and views; | ||
ok | Ewa Matejska (Palmsource) | Linux Ubuntu 6.10, Sun 1.5.0_10 | Linux-ssh, Linux-ftp, Linux-dstore | CDT Remote Launch and Basic Sanity Test | Ewa bugs |
ok | Burak Kulakli (Cabot) | WinXP SP2, Sun 1.6.0 | Unix-ssh, Windows-Local | (Copy|Move|Delete)(File|Directory) from (LOCAL|REMOTE) to (LOCAL|REMOTE) | Burak bugs |
Test Features
RSE Features signed up already
- MartinO:
- MV Shell Processes Subsystem
- Terminal (ssh,telnet,serial)
- Shell Content Assist-Linux (local,ssh,dstore)
- Shell Content Assist-Windows (local,dstore)
- Shell Pattern Matching (Compiler Error Navigation, Directory and File Navigation)
- DaveD:
- Basic Sanity Test (of course)
- Subsystem properties
- RSE Views
- Connection problems
- Preferences
RSE Features that are particularly important to test
- Verifications: 2.0M6 Bugs (by date) fixed but not yet verified
- Basic Sanity Test (File Subsystem, dirlist, simple filters, upload/download/edit, Tableview)
- File Encodings (Foreign language files on remote side)
- CDT Remote Launch
- Drag&Drop, Copy&Paste (RSE <-> RSE, Eclipse Navigator, Windows Explorer, Overwrite vs. Rename)
- Discovery
- EFS
RSE Features to test
- Dstore Launch Options (Rlogin, Already-Running, Port Ranges, SSL Connection)
- Parallel access (multiple parallel actions)
- Update Site: Install & Upgrade via Update Site
- Scalability (Really large file lists, lots of events)
- Processes Subsystem (List, Sort, Kill, Remote Monitor)
- Verify Extension Points (Check docs, use in own code)
- Remote Search (dstore only)
- Complex Filters (Multiple filter strings, Filter by filetype, Filter Persistence...)
- Preferences (Walk through each of the Preferences and enable/disable)
- Subsystem Properties (Changing Properties of Systems/Subsystems in the RSE Tree)
- Synchronous operation (Do a sanity check with "Deferred Queries" switched off in Preferences)
- Dirty Editors and Merging (Editing a Remote File that also changes remotely)
- File Access Permissions and Timestamps (Read-only files etc.)
- RSE Views: Treeview, Tableview, Monitor, Properties, Scratchpad, Editor, Compare (Check for consistency)
- RSE Widgets & Dialogs: Remote file-browse, Remote move-to
- Connection Problems (Very slow connections, unavailable/unreliable hosts, timeouts, breaking connections)
Features not to be tested this time
- Team Support (Share connections, Connection Profiles)
- Verify Copyright and Externalized Strings (Run automated checks, chkpii)
- Verify Legal (Feature Descriptions, Licenses in all source features, Overall license)
- Verify User Docs (Walk through tutorial, Context Help, Check Links, Search feature)
- Verify ISV Tutorial (Walk through ISV tutorial)
- Verify ISV Docs (Broken Links, Semantic correctness, Searchable docs, Useful Javadoc)
Client Platforms
Windows XP | MartinO (SP1; Sun1.4.2_14); KushalM (SP2; IBM1.5); NorbertP (SP2; Sun1.5.0_06); SumitS (SP2; Sun1.4.2_10); MichaelScharf (SP2; Sun1.5.0_07); |
Windows 2000 | JavierM (Sun 1.4.2_10); |
Linux-x86-gtk | MartinO (RHEL4, Sun1.6.0_01); DaveM (SLES9, IBM1.4.2_sr3); EwaM (Ubuntu 6.10) |
Linux-x86_64-gtk | LotharW (Kubuntu 6.06); UweS (openSUSE 10.2, Sun 1.5.0_10 (64Bit)) |
Solaris-gtk | MartinO (Solaris9, Sun 1.5.0_11); |
Mac OS X | DaveD (10.4.7, Sun1.5.0_06); KushalM |
Linux-ppc-gtk | |
Linux-Motif | |
AIX |
Target Platforms
Windows-dstore | MartinO (XP-SP1, Sun1.4.2_14); MichaelScharf (XP-SP1, Sun1.5.0_07); |
Windows-ssh | |
Windows-ftp | JavierM (FileZilla 0.9.8b); MichaelScharf (GNU inetutils 1.3.2) |
Linux-dstore | MartinO (RHEL4, Sun1.4.2_13); NorbertP (SUSE10.0; Sun1.4.2_06); UweS (SUSE10.1; Sun1.5.0_07); EwaM (Ubuntu6.10, Sun1.5.0_10); MichaelScharf (SUSE10.1; Sun1.6.0-beta2); |
Linux-ssh | MartinO (RHEL4); MartinO (SUSE Enterprise 10 PPC); UweS (SUSE10.1); EwaM (Ubuntu6.10); BurakK (Fedora5); MichaelScharf (SUSE10.1); |
Linux-ftp | MichaelScharf (SUSE10.1); EwaM (Ubuntu6.10); |
Solaris-dstore | MartinO (Sol9, Sun1.5.0_11); MartinO (Sol10, Sun1.5.0_11) |
Solaris-ssh | MartinO (Sol9); |
Solaris-ftp | |
HPUX-dstore | |
HPUX-ssh | SumitS (HP-UX11.11); |
HPUX-ftp | |
AIX-dstore | KushalM |
AIX-ssh | |
AIX-ftp | |
MacOSX-dstore | DaveD (10.4.7, Sun1.5.0_06); |
MacOSX-ssh | GregW (10.4.7, Sun1.5.0_06); |
MacOSX-ftp | |
VMS-ftp | |
MVS-ftp | |
VxWorks-ftp | MartinO (VxSim SIMNT 6.4) |
Test Reports and Bugs Found
- Test Candidates:
- Test Results:
- Internal Reports:
- Bugzilla report: Reporter X Severity by date, reported during test period (2007-04-03 - 2007-04-08)
- Bugzilla report: Reporter X Fix status by date, for bugs reported during test period (2007-04-03 - 2007-04-08)
- Bugs fixed for 2.0M6 by date including verified and closed
- Bugs fixed for 2.0M6 by target milestone