Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "TM 2.0 M5 Testing"
(→Test Matrix) |
|||
Line 174: | Line 174: | ||
* Test Results: | * Test Results: | ||
− | |||
** [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&classification=DSDP&product=Target+Management&chfieldfrom=2007-02-20&chfieldto=2007-02-25&chfield=%5BBug+creation%5D&cmdtype=doit New bugs opened during test period] | ** [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&classification=DSDP&product=Target+Management&chfieldfrom=2007-02-20&chfieldto=2007-02-25&chfield=%5BBug+creation%5D&cmdtype=doit New bugs opened during test period] | ||
+ | ** [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&classification=DSDP&product=Target+Management&chfieldfrom=2007-02-20&chfieldto=2007-02-25&chfield=bug_status&chfieldvalue=REOPENED&cmdtype=doit Bugs reopened during test period] | ||
** [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&classification=DSDP&product=Target+Management&bug_status=VERIFIED&bug_status=CLOSED&chfieldfrom=2007-02-20&chfieldto=2007-02-25&chfield=bug_status&cmdtype=doit Bugs verified or closed during test period] | ** [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&classification=DSDP&product=Target+Management&bug_status=VERIFIED&bug_status=CLOSED&chfieldfrom=2007-02-20&chfieldto=2007-02-25&chfield=bug_status&cmdtype=doit Bugs verified or closed during test period] | ||
* Internal Reports: | * Internal Reports: | ||
− | |||
** [https://bugs.eclipse.org/bugs/report.cgi?x_axis_field=bug_severity&y_axis_field=reporter&z_axis_field=&query_format=report-table&classification=DSDP&product=Target+Management&chfieldfrom=2007-02-20&chfieldto=2007-02-25&chfield=%5BBug+creation%5D&chfieldvalue=&format=table&action=wrap Bugzilla report: Reporter X Severity by date], 2007-02-20 - 2007-02-25 | ** [https://bugs.eclipse.org/bugs/report.cgi?x_axis_field=bug_severity&y_axis_field=reporter&z_axis_field=&query_format=report-table&classification=DSDP&product=Target+Management&chfieldfrom=2007-02-20&chfieldto=2007-02-25&chfield=%5BBug+creation%5D&chfieldvalue=&format=table&action=wrap Bugzilla report: Reporter X Severity by date], 2007-02-20 - 2007-02-25 | ||
− |
Revision as of 09:44, 21 February 2007
Nav: DSDP/TM | TM 2.0 Testing | TM 2.0 M5 Testing | TM 2.0 Test Instructions | TM 2.0 Known Issues and Workarounds | TM Manual Test Plan
This is the master coordination page for TM 2.0 M5 Testing, to be done with Target Management 2.0 M5, 20-Feb-2007. Please sign up here for testing particular features of TM 2.0 M5, or a particular host / target combination. It is important for all of us to coordinate our efforts
- In order to get bugs submitted early, such that we can fix them for the release
- In order to avoid duplication of testing work
- In order to get a good test coverage and exposure of TM / RSE.
Contents
Organization and Signup
The main focus in this round of testing is to find final obvious showstoppers, and to verify the integration into the Europa Coordinated Update Site.
Most of you took part in an earlier round of testing already, so you'll not need to read all of the TM 2.0 Test Instructions. Here is some important information for this round of testing:
- Please use a customized bug entry template again. If you already have one from an earlier round of testing, change "2.0M4 Testing" into "2.0M5 Testing" and save it as your new bookmark for this round of testing. Otherwise, use this link to show, modify and save a sample bug entry template.
- If possible, please use the JDK versions as signed up in the table below. These are chosen to comply with our Reference Platforms and JDK versions. Edit the table below if you need to use a different JDK version.
- Downloads to test are at I20070220-1126
- Works with Eclipse 3.2 or later, but we focus on Eclipse 3.3M5
- Updates Site to test is at http://download.eclipse.org/dsdp/tm/testUpdates
- Known issues are at TM 2.0 Known Issues and Workarounds
- Dstore Shell doesnt come up on 1st invocation
- You'll have two tasks for testing this time:
- 1. Bug verification - For verifying your assigned bugs, please click on "your" link in the table. Please verify bugs in a downloaded, installed version only and not in your workspace! When you verified a bug OK, set it to VERIFIED. Bugzilla allows you to click on the "next bug" link so you'll be able to move through the list quite quickly.
- 2. Sanity check - please use RSE in a "normal" way as you'd usually use it. Report any bad behavior.
Thanks to everybody who signs up and thus helps making RSE better!
Test Matrix
ok | Tester Name (Company) | Client Platform | Connection types | RSE Features | Time used, Comments |
ok | Dave Dykstal (IBM) | MacOS X 10.4.8, Sun 1.5.0_06-112 | Dstore-Mac, Dstore-Linux, Dstore-Win | Macintosh related. Team features. Persistence & model features (filters, filter pools, ...) | can commit 3 hours: Results |
ok | Dave McKnight (IBM) | Linux-GTK (SLES 9), IBMj 1.4.2 sr3 | Dstore-Windows, FTP | 4 hours: Results | |
ok | Kushal Munir (IBM) | Windows XP SP2, IBMj 5.0 | Dstore-Unix (on AIX) | Drag&Drop, Copy&Paste, New Connection Wizard, Encodings, Dstore Launch Options, File Access Permissions and Timestamps | Results |
ok | Javier Montalvo (Symbian) | Windows 2000, Sun 1.4.2_12 | Windows-local, FTP | ftp filters and views; filtetype filters, deep filters, drag&drop, copy&paste (contexts) | Results |
ok | Martin Oberhuber (Wind River) | Solaris 9-Motif, Sun 1.5.0_08 | Solaris-local, Unix-dstore | Connection Problems, Shells-Contentassist, Widgets and Views, Processes | Results |
ok | Martin Oberhuber (Wind River) | WinXP SP1, Sun 1.4.2_13 | Windows-Local, Linux-ssh | Connection Problems, Discovery, Terminal(Telnet,Ssh,Serial), Shells-Contentassist, Shell-Processes | Results |
Tobias Schwarz (Wind River) | WinXP SP2, Sun 1.5.0_08 | Windows-Local, Testsubsys | Verify Tobias bugs; Filtering, Extension Points | ||
Uwe Stieber (Wind River) | Linux SUSE 10.2, Sun 1.5.0_10 | Linux-Local, Testsubsys | Verify Uwe bugs; Extension Points | ||
Lothar Werzinger (Tradescape) | Linux Kubuntu 6.06 x64 GTK, Sun 1.5.0_06 | Linux-ssh, Windows-dstore | ssh filters and views; | ||
ok | Ewa Matejska (Palmsource) | Linux Ubuntu 6.10, Sun 1.5.0_10 | Linux-ssh, Linux-ftp, Linux-dstore | CDT Remote Launch and Basic Sanity Test |
Test Features
RSE Features signed up already
- MartinO:
- MV Shell Processes Subsystem
- Terminal (ssh,telnet,serial)
- Shell Content Assist-Linux (local,ssh,dstore)
- Shell Content Assist-Windows (local,dstore)
- Shell Pattern Matching (Compiler Error Navigation, Directory and File Navigation)
RSE Features that are particularly important to test
- Verifications: 2.0M5 Bugs (by date) fixed but not yet verified
- Basic Sanity Test (File Subsystem, dirlist, simple filters, upload/download/edit, Tableview)
- File Encodings (Foreign language files on remote side)
- CDT Remote Launch
- Drag&Drop, Copy&Paste (RSE <-> RSE, Eclipse Navigator, Windows Explorer, Overwrite vs. Rename)
RSE Features to test
- Dstore Launch Options (Rlogin, Already-Running, Port Ranges, SSL Connection)
- Parallel access (multiple parallel actions)
- Update Site: Install & Upgrade via Update Site
- Scalability (Really large file lists, lots of events)
- Processes Subsystem (List, Sort, Kill, Remote Monitor)
- Verify Extension Points (Check docs, use in own code)
- Remote Search (dstore only)
- Complex Filters (Multiple filter strings, Filter by filetype, Filter Persistence...)
- Preferences (Walk through each of the Preferences and enable/disable)
- Subsystem Properties (Changing Properties of Systems/Subsystems in the RSE Tree)
- Synchronous operation (Do a sanity check with "Deferred Queries" switched off in Preferences)
- Dirty Editors and Merging (Editing a Remote File that also changes remotely)
- File Access Permissions and Timestamps (Read-only files etc.)
- RSE Views: Treeview, Tableview, Monitor, Properties, Scratchpad, Editor, Compare (Check for consistency)
- RSE Widgets & Dialogs: Remote file-browse, Remote move-to
- Connection Problems (Very slow connections, unavailable/unreliable hosts, timeouts, breaking connections)
- Discovery
Features not to be tested this time
- Team Support (Share connections, Connection Profiles)
- Verify Copyright and Externalized Strings (Run automated checks, chkpii)
- Verify Legal (Feature Descriptions, Licenses in all source features, Overall license)
- Verify User Docs (Walk through tutorial, Context Help, Check Links, Search feature)
- Verify ISV Tutorial (Walk through ISV tutorial)
- Verify ISV Docs (Broken Links, Semantic correctness, Searchable docs, Useful Javadoc)
- EFS
Client Platforms
Windows XP | MartinO (SP1; Sun1.5.0_10); KushalM (SP2; IBM1.5); NorbertP (SP2; Sun1.5.0_06); SumitS (SP2; Sun1.4.2_10); MichaelScharf (SP2; Sun1.5.0_07); |
Windows 2000 | JavierM (Sun 1.4.2_10); |
Linux-x86-gtk | MartinO (RHEL4, Sun1.4.2_12); DaveM (SLES9, IBM1.4.2_sr3); EwaM (Ubuntu 6.10) |
Linux-ppc-gtk | |
Solaris-motif | MartinO (Solaris9); |
Mac OS X | DaveD (10.4.7, Sun1.5.0_06); |
Linux-x86_64-gtk | LotharW (Kubuntu 6.06); |
Linux-Motif |
Target Platforms
Windows-dstore | MartinO (XP-SP1, Sun1.5.0_08); MichaelScharf (XP-SP1, Sun1.5.0_07); |
Windows-ssh | |
Windows-ftp | JavierM (FileZilla 0.9.8b); MichaelScharf (GNU inetutils 1.3.2) |
Linux-dstore | MartinO (RHEL4, Sun1.4.2_12); NorbertP (SUSE10.0; Sun1.4.2_06); UweS (SUSE10.1; Sun1.5.0_07); EwaM (Ubuntu6.10, Sun1.5.0_10); MichaelScharf (SUSE10.1; Sun1.6.0-beta2); |
Linux-ssh | MartinO (RHEL4); UweS (SUSE10.1); EwaM (Ubuntu6.10); BurakK (Fedora5); MichaelScharf (SUSE10.1); |
Linux-ftp | MichaelScharf (SUSE10.1); EwaM (Ubuntu6.10); |
Solaris-dstore | |
Solaris-ssh | MartinO (Sol7, Sol8, Sol9); |
Solaris-ftp | |
HPUX-dstore | |
HPUX-ssh | SumitS (HP-UX11.11); |
HPUX-ftp | |
AIX-dstore | KushalM |
AIX-ssh | |
AIX-ftp | |
MacOSX-dstore | DaveD (10.4.7, Sun1.5.0_06); |
MacOSX-ssh | GregW (10.4.7, Sun1.5.0_06); |
MacOSX-ftp | |
VMS-ftp | |
MVS-ftp | |
VxWorks-ftp |
Test Reports and Bugs Found
- Test Candidates:
- Test Results:
- Internal Reports:
- Bugzilla report: Reporter X Severity by date, 2007-02-20 - 2007-02-25