Jump to: navigation, search

Difference between revisions of "TM 3.0 RC2 Testing"

 
 
(22 intermediate revisions by 6 users not shown)
Line 14: Line 14:
  
 
== Organization ==
 
== Organization ==
 +
The main focus is a good round of '''Sanity Test''' to find '''obvious showstoppers'''.
 +
* [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&classification=DSDP&product=Target+Management&bug_status=RESOLVED&resolution=FIXED&resolution=WORKSFORME&chfieldfrom=2007-09-29&chfieldto=2008-05-28&chfield=resolution&chfieldvalue=&cmdtype=doit Bugs fixed for 3.0 but not yet verified]
 +
 +
Most of you took part in an earlier round of testing already, so you'll not need to read all of the [[TM 2.0 Test Instructions]]. Here is some important information for this round of testing:
 +
 +
* Please use a customized bug entry template again. If you already have one from an earlier round of testing, change it to "3.0RC3 Testing" and save it as your new bookmark for this round of testing. Otherwise, use [https://bugs.eclipse.org/bugs/enter_bug.cgi?product=Target%20Management&version=3.0&component=RSE&comment=%0D%0A-----------Enter%20bugs%20above%20this%20line-----------%0D%0ATM%203.0RC2%20Testing%0D%0Ainstallation%20%3A%20eclipse-SDK-3.4RC2-win32%2C%20cdt-5.0.0RC2%2C%20emf-sdo-xsd-2.4.0RC2%0D%0A%20%20%20%20%20Download%20RSE-RC2%3A%20RSE-SDK%2Ctests%2Cdiscovery%2Cterminal%2Cremotecdt%0D%0Ajava.runtime%20%3A%20Sun%201.5.0_11-b03%2C%20mixed%20mode%0D%0Aos.name%3A%20%20%20%20%20%3A%20Windows%20XP%205.1%2C%20Service%20Pack%201%0D%0A------------------------------------------------%0D%0Asystemtype%20%20%20%3A%20Linux-local%20%2F%20Windows-dstore%20%28Daemon%29%20%2F%20Unix-dstore%20%28RExec%29%0D%0Atargetos1%20%20%20%20%3A%20Linux%20RHEL4%2C%20Sun%201.5.0_11%0D%0Atargetos2%20%20%20%20%3A%20Windows%20XP%20SP1%2C%20Sun%201.5.0_11%0D%0Atargetos3%20%20%20%20%3A%20Solaris-sparc%205.9%2C%20Sun%201.4.2_05%0D%0Atargetuname%20%20%3A%20SunOS%20szg-anar%205.9%20Generic_118558-06%20sun4u%20sparc%20SUNW%2CSun-Blade-1500%0D%0A------------------------------------------------%0D%0A&form_name=enter_bug this link to show, modify and save a sample bug entry template]. The point here is that we'd like to know your JVM version / OS version.
 +
* Downloads to test are [http://download.eclipse.org/dsdp/tm/downloads/index.php at the TM download page], [http://download.eclipse.org/dsdp/tm/downloads/drops/S-3.0RC2-200805271940/ TM S-3.0RC2-200805271940]
 +
* Official Test Platform is the RC2 release from the [http://download.eclipse.org/eclipse/downloads/ Eclipse Platform].
 +
* Updates Site to test is at http://download.eclipse.org/dsdp/tm/testUpdates
 +
* Ganymede Integration Staging Site is at http://download.eclipse.org/releases/ganymede/staging
 +
* Known issues are at [[TM 3.0 Known Issues and Workarounds]]
 +
** Currently open [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&classification=DSDP&product=Target+Management&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&bug_severity=blocker&bug_severity=critical&bug_severity=major&cmdtype=doit major, critical, blocker] issues
 +
** Currently open [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=DSDP&product=Target+Management&target_milestone=3.0+RC2&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= bugs assigned to 3.0RC2]
 +
** Currently open [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&classification=DSDP&product=Target+Management&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&chfieldfrom=2008-05-28&chfieldto=2008-05-30&chfield=%5BBug+creation%5D&cmdtype=doit bugs detected during testing]
 +
<!--
 +
* Components affected by fixes for [http://download.eclipse.org/dsdp/tm/downloads/drops/I2007____ I2007____]:
 +
** '''Filters''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=181394 181394] filter shows data from wrong connection
 +
** '''EFS''' [https://bugs.eclipse.org/bugs/show_bug.cgi?id=180091 180091] Use handles to fix EFS project on workbench startup; [https://bugs.eclipse.org/bugs/show_bug.cgi?id=177323 177323] No query from EFS on workbench shutdown;
 +
-->
 +
 +
* '''Sanity check instructions:''' please use RSE in a "normal" way as you'd usually use it. [[RSE 1.0 Test Instructions#Step_5:_Basic_Sanity_Check|RSE 1.0 Test Instructions]]. Please test on your selected host/target combination. Try to avoid duplication with others. Report any bad behavior.
 +
 +
'''Thanks''' to everybody who signs up and thus helps making RSE better!
 +
 
== Signup Matrix ==
 
== Signup Matrix ==
 +
{| border="1"
 +
! Tester Name (Company) !! Client Platform !! Connection types !! RSE Features !! Comments
 +
|-
 +
| Dave Dykstal (IBM) || MacOS X 10.5.2 || dstore-mac || Macintosh related. "Team" view. Persistence & model features (filters, filter pools, ...). Import Export. Basic Sanity Testing. Documentation Review. File operations.|| none
 +
|-
 +
| Martin Oberhuber (Wind River) || Solaris 10, Sun 1.5.0_11 || Local || Custom / dynamic system types, filters, actions || none
 +
|-
 +
| Dave McKnight (IBM) || || || ||
 +
|-
 +
| Xuan Chen (IBM) ||Windows XP, IBM 1.6 JRE ||Local, dstore-linux || Sanity Test + User actions + some tryout for Import/Export connections + ftp on I5/OS system ||
 +
|-
 +
| Kevin Doyle (IBM) || Windows XP || dstore-linux || Sanity Test + verifying bugs || none
 +
|-
 +
| Rupen Mardirossian (IBM) || || || ||
 +
|-
 +
| Uwe Stieber (Wind River) || || || ||
 +
|-
 +
| Felix Burton (Wind River) || || || ||
 +
|-
 +
| Michael Scharf (Wind River) || || || ||
 +
|-
 +
| Eugene Tarassov (Wind River) || || || ||
 +
|-
 +
| Javier Montalvo-Orus () || || || ||
 +
|-
 +
| Radoslav Gerganov (ProSyst) || Win2k SP4, Sun 1.6.0_05 || ftp || Basic Sanity Test, EFS, Dirty Editors and Merging, File Access Permissions and Timestamps || none
 +
|-
 +
| Anna Dushistova (Montavista) || SuSE Linux 10.1, Sun 1.5.0_06 || ssh || Remotecdt Launch, Processes subsystem || none
 +
|}
 +
 +
== Install Scenarios ==
 +
Need to test all scenarios, see {{bug|231453}}
 +
:1. (standard) TM 3.0 ZIPs into Eclipse-SDK 3.4 dropins/ (including emf, remotecdt)
 +
:2. '''Martin''' TM 3.0 ZIPs into Eclipse-SDK 3.3.2 (with EMF-2.2.4, CDT-3.1)
 +
:3. '''Martin''' TM-Updatesite-P2: Eclipse-platform-3.4 plus EMF-2.2.4 from ZIPs; get CDT from CDT-Site; get TM from TM-site
 +
:4. '''DaveD''' Ganymede-P2: Start from Eclipse-platform-3.4 plain, select TM-all on Ganymede-site, have CDT+EMF autoselectd for install
 +
:5. Update TM-3.0rc3 to TM-3.0rc3++: With the install from (4), "Check for Updates" to ensure get latest TM
 +
:6. '''Martin''' Update TM-2.0 to TM-3.0 (old UM): Given Eclipse-3.3.2, EMF-2.3.2, CDT-4.0.2; Update to TM 3.0 only by pointing to TM site
 +
 
== Features ==
 
== Features ==
 
=== RSE ===
 
=== RSE ===
=== Terminal ===
+
* Verifications: [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&classification=DSDP&product=Target+Management&bug_status=RESOLVED&resolution=FIXED&resolution=WORKSFORME&chfieldfrom=2007-06-29&chfieldto=2008-05-28&chfield=resolution&chfieldvalue=&cmdtype=doit 3.0 Bugs (by date) fixed but not yet verified]
=== Discovery ===
+
* '''Xuan''' Import/Export Connections
 +
* [[TM Manual Test Plan#Basic Sanity Test|Basic Sanity Test]] (File Subsystem, dirlist, simple filters, upload/download/edit, Tableview)
 +
* [[TM Manual Test Plan#File Encodings|File Encodings]] (Foreign language files on remote side)
 +
* [[TM Manual Test Plan#CDT Remote Launch|CDT Remote Launch]]
 +
* [[TM Manual Test Plan#Drag&Drop, Copy&Paste|Drag&Drop, Copy&Paste]] (RSE <-> RSE, Eclipse Navigator, Windows Explorer, Overwrite vs. Rename)
 +
* [[TM Manual Test Plan#Discovery|Discovery]]
 +
* [[TM Manual Test Plan#EFS|EFS]]
 +
* [[TM Manual Test Plan#Dstore Launch Options|Dstore Launch Options]] (Rlogin, Already-Running, Port Ranges, SSL Connection)
 +
* [[TM Manual Test Plan#Parallel access|Parallel access]] (multiple parallel actions)
 +
* [[TM Manual Test Plan#Update Site|Update Site]]: Install & Upgrade via Update Site (using P2)
 +
* [[TM Manual Test Plan#Scalability|Scalability]] (Really large file lists, lots of events)
 +
* [[TM Manual Test Plan#Processes Subsystem|Processes Subsystem]] (List, Sort, Kill, Remote Monitor)
 +
** MV Shell Processes Subsystem
 +
* [[TM Manual Test Plan#Verify Extension Points|Verify Extension Points]] (Check docs, use in own code)
 +
* [[TM Manual Test Plan#Remote Search|Remote Search]] (dstore only)
 +
* [[TM Manual Test Plan#Complex Filters|Complex Filters]] (Multiple filter strings, Filter by filetype, Filter Persistence...)
 +
* [[TM Manual Test Plan#Preferences|Preferences]] (Walk through each of the Preferences and enable/disable)
 +
* [[TM Manual Test Plan#Subsystem Properties|Subsystem Properties]] (Changing Properties of Systems/Subsystems in the RSE Tree)
 +
* [[TM Manual Test Plan#Synchronous operation|Synchronous operation]] (Do a sanity check with "Deferred Queries" switched off in Preferences)
 +
* [[TM Manual Test Plan#Dirty Editors and Merging|Dirty Editors and Merging]] (Editing a Remote File that also changes remotely)
 +
* [[TM Manual Test Plan#File Access Permissions and Timestamps|File Access Permissions and Timestamps]] (Read-only files etc.)
 +
* [[TM Manual Test Plan#RSE Views|RSE Views]]: Treeview, Tableview, Monitor, Properties, Scratchpad, Editor, Compare (Check for consistency)
 +
* [[TM Manual Test Plan#RSE Widgets & Dialogs|RSE Widgets & Dialogs]]: Remote file-browse, Remote move-to
 +
* [[TM Manual Test Plan#Connection Problems|Connection Problems]] (Very slow connections, unavailable/unreliable hosts, timeouts, breaking connections)
 +
* [[TM Manual Test Plan#Team Support|Team Support]] (Connection Profiles)
 +
* [[TM Manual Test Plan#Verify User Docs|Verify User Docs]] (Walk through tutorial, Context Help, Check Links, Search feature)
 +
* [[TM Manual Test Plan#Verify ISV Tutorial|Verify ISV Tutorial]] (Walk through ISV tutorial)
 +
* [[TM Manual Test Plan#Verify ISV Docs|Verify ISV Docs]] (Broken Links, Semantic correctness, Searchable docs, Useful Javadoc)
 +
* [[TM Manual Test Plan#Shell Content Assist-Linux|Shell Content Assist-Linux]] (local,ssh,dstore)
 +
* [[TM Manual Test Plan#Shell Content Assist-Windows|Shell Content Assist-Windows]] (local,dstore)
 +
* [[TM Manual Test Plan#Shell Pattern Matching|Shell Pattern Matching]] (Compiler Error Navigation, Directory and File Navigation)
 +
==== Not to be tested ====
 +
* [[TM Manual Test Plan#Verify Copyright and Externalized Strings|Verify Copyright and Externalized Strings]] (Run automated checks, chkpii)
 +
* [[TM Manual Test Plan#Verify Legal|Verify Legal]] (Feature Descriptions, Licenses in all source features, Overall license)
 +
 
 
== Platforms ==
 
== Platforms ==
 
=== Client ===
 
=== Client ===
 +
 +
Please fill in your client and java version. Feel free to move yourself around in this table to match your current set up.
 +
 +
{| border="1"
 +
| Windows XP || MartinO (SP1; Sun1.4.2_14); MichaelScharf (SP2; Sun1.5.0_07)
 +
|-
 +
| Linux-x86-gtk || MartinO (RHEL4, Sun1.6.0_01); DaveM (SLES9, IBM1.4.2_sr3); Anna (Suse 10.1, Sun 1.5.0_06)
 +
|-
 +
| Linux-x86_64-gtk || UweS (openSUSE 10.2, Sun 1.5.0_10 (64Bit))
 +
|-
 +
| Solaris-gtk || MartinO (Solaris9, Sun 1.5.0_11);
 +
|-
 +
| Mac OS X || DaveD (10.5.2, Sun1.5.0_13)
 +
|-
 +
| Linux-ppc-gtk ||
 +
|-
 +
| Linux-Motif ||
 +
|-
 +
| AIX ||
 +
|}
 +
 
=== Target ===
 
=== Target ===
 +
Please edit your current set up.
 +
{| border="1"
 +
| Windows-dstore || MartinO (XP-SP1, Sun1.4.2_14); MichaelScharf (XP-SP1, Sun1.5.0_07);
 +
|-
 +
| Windows-ssh ||
 +
|-
 +
| Windows-ftp || JavierM (FileZilla 0.9.8b); MichaelScharf (GNU inetutils 1.3.2); Rado (FileZilla 0.9.25 beta)
 +
|-
 +
| Linux-dstore || MartinO (RHEL4, Sun1.4.2_13); NorbertP (SUSE10.0; Sun1.4.2_06); UweS (SUSE10.1; Sun1.5.0_07);  MichaelScharf (SUSE10.1; Sun1.6.0-beta2);
 +
|-
 +
| Linux-ssh || MartinO (RHEL4); MartinO (SUSE Enterprise 10 PPC); UweS (SUSE10.1); MichaelScharf (SUSE10.1); Rado (Debian sarge); Anna (SUSE10.1)
 +
|-
 +
| Linux-ftp || MichaelScharf (SUSE10.1); EwaM (Ubuntu6.10);
 +
|-
 +
| Solaris-dstore || MartinO (Sol9, Sun1.5.0_11); MartinO (Sol10, Sun1.5.0_11)
 +
|-
 +
| Solaris-ssh || MartinO (Sol9);
 +
|-
 +
| Solaris-ftp ||
 +
|-
 +
| HPUX-dstore ||
 +
|-
 +
| HPUX-ssh || SumitS (HP-UX11.11);
 +
|-
 +
| HPUX-ftp ||
 +
|-
 +
| AIX-dstore ||
 +
|-
 +
| AIX-ssh ||
 +
|-
 +
| AIX-ftp ||
 +
|-
 +
| MacOSX-dstore || DaveD (10.5.2, Sun1.5.0_13);
 +
|-
 +
| MacOSX-ssh || DaveD (10.5.2, Sun1.5.0_13);
 +
|-
 +
| MacOSX-ftp || DaveD (10.5.2, Sun1.5.0_13);
 +
|-
 +
| VMS-ftp ||
 +
|-
 +
| MVS-ftp ||
 +
|-
 +
| VxWorks-ftp || MartinO (VxSim SIMNT 6.4)
 +
|}

Latest revision as of 13:26, 5 June 2008

Nav: DSDP/TM | DSDP/TM/Testing | TM 3.0 Testing | TM 3.0 RC2 Testing | TM 2.0 Test Instructions | TM 2.0 Known Issues and Workarounds | TM Manual Test Plan


This is the master coordination page for TM 3.0 RC2 Testing. Testing will run from Wednesday 28-May-2008 to 5:00 p.m. (EDT) Friday 30-May-2008. RC2 will be built on Tuesday 27 May 2008. Please sign up here for testing particular features, or a particular host/target combination. It is important for all of us to coordinate our efforts

  • In order to get critical bugs submitted early so that we can fix them for RC3
  • In order to avoid duplication of testing work
  • In order to get a good test coverage and exposure of TM / RSE.


Organization

The main focus is a good round of Sanity Test to find obvious showstoppers.

Most of you took part in an earlier round of testing already, so you'll not need to read all of the TM 2.0 Test Instructions. Here is some important information for this round of testing:

  • Sanity check instructions: please use RSE in a "normal" way as you'd usually use it. RSE 1.0 Test Instructions. Please test on your selected host/target combination. Try to avoid duplication with others. Report any bad behavior.

Thanks to everybody who signs up and thus helps making RSE better!

Signup Matrix

Tester Name (Company) Client Platform Connection types RSE Features Comments
Dave Dykstal (IBM) MacOS X 10.5.2 dstore-mac Macintosh related. "Team" view. Persistence & model features (filters, filter pools, ...). Import Export. Basic Sanity Testing. Documentation Review. File operations. none
Martin Oberhuber (Wind River) Solaris 10, Sun 1.5.0_11 Local Custom / dynamic system types, filters, actions none
Dave McKnight (IBM)
Xuan Chen (IBM) Windows XP, IBM 1.6 JRE Local, dstore-linux Sanity Test + User actions + some tryout for Import/Export connections + ftp on I5/OS system
Kevin Doyle (IBM) Windows XP dstore-linux Sanity Test + verifying bugs none
Rupen Mardirossian (IBM)
Uwe Stieber (Wind River)
Felix Burton (Wind River)
Michael Scharf (Wind River)
Eugene Tarassov (Wind River)
Javier Montalvo-Orus ()
Radoslav Gerganov (ProSyst) Win2k SP4, Sun 1.6.0_05 ftp Basic Sanity Test, EFS, Dirty Editors and Merging, File Access Permissions and Timestamps none
Anna Dushistova (Montavista) SuSE Linux 10.1, Sun 1.5.0_06 ssh Remotecdt Launch, Processes subsystem none

Install Scenarios

Need to test all scenarios, see bug 231453

1. (standard) TM 3.0 ZIPs into Eclipse-SDK 3.4 dropins/ (including emf, remotecdt)
2. Martin TM 3.0 ZIPs into Eclipse-SDK 3.3.2 (with EMF-2.2.4, CDT-3.1)
3. Martin TM-Updatesite-P2: Eclipse-platform-3.4 plus EMF-2.2.4 from ZIPs; get CDT from CDT-Site; get TM from TM-site
4. DaveD Ganymede-P2: Start from Eclipse-platform-3.4 plain, select TM-all on Ganymede-site, have CDT+EMF autoselectd for install
5. Update TM-3.0rc3 to TM-3.0rc3++: With the install from (4), "Check for Updates" to ensure get latest TM
6. Martin Update TM-2.0 to TM-3.0 (old UM): Given Eclipse-3.3.2, EMF-2.3.2, CDT-4.0.2; Update to TM 3.0 only by pointing to TM site

Features

RSE

Not to be tested

Platforms

Client

Please fill in your client and java version. Feel free to move yourself around in this table to match your current set up.

Windows XP MartinO (SP1; Sun1.4.2_14); MichaelScharf (SP2; Sun1.5.0_07)
Linux-x86-gtk MartinO (RHEL4, Sun1.6.0_01); DaveM (SLES9, IBM1.4.2_sr3); Anna (Suse 10.1, Sun 1.5.0_06)
Linux-x86_64-gtk UweS (openSUSE 10.2, Sun 1.5.0_10 (64Bit))
Solaris-gtk MartinO (Solaris9, Sun 1.5.0_11);
Mac OS X DaveD (10.5.2, Sun1.5.0_13)
Linux-ppc-gtk
Linux-Motif
AIX

Target

Please edit your current set up.

Windows-dstore MartinO (XP-SP1, Sun1.4.2_14); MichaelScharf (XP-SP1, Sun1.5.0_07);
Windows-ssh
Windows-ftp JavierM (FileZilla 0.9.8b); MichaelScharf (GNU inetutils 1.3.2); Rado (FileZilla 0.9.25 beta)
Linux-dstore MartinO (RHEL4, Sun1.4.2_13); NorbertP (SUSE10.0; Sun1.4.2_06); UweS (SUSE10.1; Sun1.5.0_07); MichaelScharf (SUSE10.1; Sun1.6.0-beta2);
Linux-ssh MartinO (RHEL4); MartinO (SUSE Enterprise 10 PPC); UweS (SUSE10.1); MichaelScharf (SUSE10.1); Rado (Debian sarge); Anna (SUSE10.1)
Linux-ftp MichaelScharf (SUSE10.1); EwaM (Ubuntu6.10);
Solaris-dstore MartinO (Sol9, Sun1.5.0_11); MartinO (Sol10, Sun1.5.0_11)
Solaris-ssh MartinO (Sol9);
Solaris-ftp
HPUX-dstore
HPUX-ssh SumitS (HP-UX11.11);
HPUX-ftp
AIX-dstore
AIX-ssh
AIX-ftp
MacOSX-dstore DaveD (10.5.2, Sun1.5.0_13);
MacOSX-ssh DaveD (10.5.2, Sun1.5.0_13);
MacOSX-ftp DaveD (10.5.2, Sun1.5.0_13);
VMS-ftp
MVS-ftp
VxWorks-ftp MartinO (VxSim SIMNT 6.4)