Skip to main content
Jump to: navigation, search

Difference between revisions of "PTP/testing/7.x"

< PTP‎ | testing
(Test Matrix)
(Test Matrix)
 
(17 intermediate revisions by 7 users not shown)
Line 1: Line 1:
 
== Test Plan for PTP 7.x Release  ==
 
== Test Plan for PTP 7.x Release  ==
  
This plan describes the tests that will be undertaken to verify the 7.x series of PTP releases - Eclipse 7.0.0 will be available June 26, 2013 with the Eclipse Juno (4.3) Simultaneous release.  
+
This plan describes the tests that will be undertaken to verify the 7.x series of PTP releases - Eclipse 7.0.0 will be available June 26, 2013 with the Eclipse Kepler (4.3) Simultaneous release.  
  
 
== Test Setup  ==
 
== Test Setup  ==
Line 50: Line 50:
 
== Testers  ==
 
== Testers  ==
  
Please add your name to this list, or remove the comment if you are participating in 7.0 - add a general comment to your general field of expertise/intended testing here&nbsp;  
+
Please add your name to this list, remove the comment: "(remove this if participating in 7.0)" and add a general comment to your general field of expertise/intended testing here&nbsp;  
  
*Greg Watson (remove this if participating in 7.0) - General, debugger  
+
*Greg Watson - General, debugger  
 
*Beth Tibbitts - General, PLDT, Feedback, Help, Install  
 
*Beth Tibbitts - General, PLDT, Feedback, Help, Install  
*Dave Wootton (remove this if participating in 7.0) - IBM PE/LL, ...
+
*Dave Wootton - IBM PE/LL  
*Wyatt Spear (remove this if participating in 7.0) - ETFw, TAU  
+
*Wyatt Spear - ETFw, TAU  
*Jeff Overbey - Photran
+
*Jeff Overbey - Photran  
 
*Jay Alameda (remove this if participating in 7.0)  
 
*Jay Alameda (remove this if participating in 7.0)  
*Galen Arnold (remove this if participating in 7.0)&nbsp;  
+
*Galen Arnold&nbsp;  
*Rui Liu (remove this if participating in 7.0) - Feedback  
+
*Rui Liu - Feedback  
 
*Chris Navarro - General, ETFw  
 
*Chris Navarro - General, ETFw  
 
*Roland Schulz (remove this if participating in 7.0)  
 
*Roland Schulz (remove this if participating in 7.0)  
*John Eblen (remove this if participating in 7.0) - Sync  
+
*John Eblen - Sync  
*Brian Watt (remove this if participating in 7.0) - ETFw
+
*Brian Watt - LSF
 
*Hari Krishnan (remove this if participating in 7.0)  
 
*Hari Krishnan (remove this if participating in 7.0)  
 
*Brandon Gibson (remove this if participating in 7.0) - GIG,GEM  
 
*Brandon Gibson (remove this if participating in 7.0) - GIG,GEM  
Line 81: Line 81:
 
| bgcolor="silver" | RM / target platforms  
 
| bgcolor="silver" | RM / target platforms  
 
| bgcolor="#ccffcc" | Other technical features  
 
| bgcolor="#ccffcc" | Other technical features  
| bgcolor="#ffffcc" | Misc things to test  
+
| bgcolor="#ffffcc" | Misc things to test
| <br>
+
 
|}
 
|}
  
Line 100: Line 99:
 
| style="background: white none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | Client (Please everyone<br>list here which clients<br>you will/can test in&nbsp;<br>general)  
 
| style="background: white none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | Client (Please everyone<br>list here which clients<br>you will/can test in&nbsp;<br>general)  
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
| align="center" | Zhi Ming Wang<br>
+
| align="center" |  
 +
Zhi Ming Wang  
 +
 
 +
Galen Arnold
 +
 
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | &nbsp;Beth, Greg  
 
| align="center" | &nbsp;Beth, Greg  
Line 118: Line 121:
 
| style="background: silver none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | Open MPI  
 
| style="background: silver none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | Open MPI  
 
| align="center" | ##  
 
| align="center" | ##  
| align="center" | &nbsp;??
+
| align="center" | &nbsp; Galen
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
Line 136: Line 139:
 
| style="background: silver none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | PE/LL  
 
| style="background: silver none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | PE/LL  
 
| align="center" | <br>  
 
| align="center" | <br>  
| align="center" | &nbsp;Dave (client)  
+
| align="center" | &nbsp;Dave<br>(client)  
| align="center" | &nbsp;Dave (server)  
+
| align="center" | &nbsp;Dave<br>(server)  
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | <br>  
| align="center" | &nbsp;Dave (client)  
+
| align="center" | &nbsp;Dave<br>(client)  
 
| align="center" | &nbsp;Dave
 
| align="center" | &nbsp;Dave
 
|-
 
|-
Line 171: Line 174:
 
|-
 
|-
 
| style="background: silver none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | LSF  
 
| style="background: silver none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | LSF  
| align="center" | &nbsp;??
+
| align="center" | -
| align="center" | <br>  
+
| align="center" | Brian<br>(remote client;<br>local client;<br>server)
| align="center" | <br>
+
| align="center" | -
| align="center" | <br>
+
| align="center" | -
| align="center" | <br>  
+
| align="center" | Brian<br>(remote client)
| align="center" | &nbsp;??
+
| align="center" | -
| align="center" | <br>
+
| align="center" | -
 
|-
 
|-
 
| style="background: silver none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | IBM Platform MPI  
 
| style="background: silver none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | IBM Platform MPI  
| align="center" |  
+
| align="center" | Zhi Ming Wang<br>(client)  
Zhi Ming Wang
+
| align="center" | Zhi Ming Wang<br>(client and server)  
 
+
(client)
+
 
+
| align="center" |  
+
Zhi Ming Wang<br>  
+
 
+
(client and server)
+
 
+
 
| align="center" | -  
 
| align="center" | -  
 
| align="center" | -  
 
| align="center" | -  
| align="center" |  
+
| align="center" | Zhi Ming Wang<br>(client)  
Zhi Ming Wang
+
| align="center" | Zhi Ming Wang<br>(client)  
 
+
(client)
+
 
+
| align="center" |  
+
Zhi Ming Wang<br>  
+
 
+
(client)  
+
 
+
 
| align="center" | -
 
| align="center" | -
 
|-
 
|-
Line 224: Line 211:
 
| style="background: silver none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | TORQUE  
 
| style="background: silver none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | TORQUE  
 
| align="center" | <br>  
 
| align="center" | <br>  
| align="center" | <br>  
+
| align="center" | Galen<br>  
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | <br>  
Line 230: Line 217:
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | <br>
 
| align="center" | <br>
 +
|-
 +
! &nbsp;
 +
! Linux x86*
 +
! Linux x86_64
 +
! Linux PPC
 +
! Mac 64
 +
! Win
 +
! Win 64
 +
! AIX***
 
|-
 
|-
 
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | Debugger  
 
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | Debugger  
Line 267: Line 263:
 
| align="center" | <br>
 
| align="center" | <br>
 
|-
 
|-
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | RDT + RT
+
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | RDT - Remote Projects
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
Line 276: Line 272:
 
| align="center" | <br>
 
| align="center" | <br>
 
|-
 
|-
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | RDT Sync  
+
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | RDT - Sync Projects
| align="center" | <br>  
+
| align="center" | <br> John
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
 
| align="center" | <br>  
 
| align="center" | <br>  
Line 286: Line 282:
 
|-
 
|-
 
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | Photran  
 
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | Photran  
| align="center" | Jeff
+
| align="center" | Jeff  
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | <br>  
| align="center" | Jeff
+
| align="center" | Jeff  
| align="center" | Jeff
+
| align="center" | Jeff  
| align="center" | Jeff
+
| align="center" | Jeff  
 
| align="center" | <br>
 
| align="center" | <br>
 
|-
 
|-
 
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | ETFw (Core)  
 
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | ETFw (Core)  
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
| align="center" | &nbsp;??
+
| align="center" | &nbsp;Wyatt
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | <br>  
Line 304: Line 300:
 
|-
 
|-
 
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | ETFw (Feedback)  
 
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | ETFw (Feedback)  
| align="center" | <br>
+
| align="center" | Rui
| align="center" | &nbsp;??
+
| align="center" | Rui
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
Line 314: Line 310:
 
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | ETFw (TAU)  
 
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | ETFw (TAU)  
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
| align="center" | &nbsp;??
+
| align="center" | &nbsp;Wyatt
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | <br>  
Line 341: Line 337:
 
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | Env Mgmt  
 
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | Env Mgmt  
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
| align="center" | &nbsp;??
+
| align="center" | Galen
 
| align="center" | <br>  
 
| align="center" | <br>  
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
Line 347: Line 343:
 
| align="center" | &nbsp;??  
 
| align="center" | &nbsp;??  
 
| align="center" | <br>
 
| align="center" | <br>
 +
|-
 +
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | SysMon
 +
| align="center" | &nbsp;
 +
| align="center" |
 +
| align="center" | <br>
 +
| align="center" | &nbsp;
 +
| align="center" | &nbsp;
 +
| align="center" | &nbsp;
 +
| align="center" | <br>
 +
|-
 +
| bgcolor="#ccffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | Linux tools (LT)
 +
| align="center" |
 +
| align="center" | Galen
 +
| align="center" |
 +
| align="center" |
 +
| align="center" |
 +
| align="center" |
 +
| align="center" |
 
|-
 
|-
 
| bgcolor="#ffffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | Install, Update  
 
| bgcolor="#ffffcc" style="background: none none repeat scroll 0% 0%; -moz-background-clip: -moz-initial; -moz-background-inline-policy: -moz-initial; -moz-background-origin: -moz-initial;" | Install, Update  
Line 367: Line 381:
 
|}
 
|}
  
[[PTP/testing/6.x|PTP 6.0 Testing page]] <br> <nowiki>?? Name was here for 6.0 testing, not updated for 7.0</nowiki> <br><nowiki>* Only the GTK 2 version of Eclipse will be tested</nowiki> <br> <nowiki>*** AIX testing is for the server side only.</nowiki> <br> α Limited testing only <br> (client) indicates that eclipse runs here<br> (server) indicates remote target runs here <br> (R) will test remote usage<br> (L) will test local usage <br> <nowiki>## old (not updated to PTP 7.0 testing) - remove ## if you update this and/or confirm you are still testing this</nowiki> <br>  
+
[[PTP/testing/6.x|PTP 6.0 Testing page]] <br> <nowiki>?? Name was here for 6.0 testing, not updated for 7.0</nowiki> <br><nowiki>* Only the GTK 2 version of Eclipse will be tested</nowiki> <br> <nowiki>*** AIX testing is for the server side only.</nowiki> <br> α Limited testing only <br> (client) indicates that eclipse runs here<br> (server) indicates remote target runs here <br> (R) will test remote usage<br> (L) will test local usage <br> <nowiki>(LT) linux tools - test at least that the components are present and should work as they do elsewhere</nowiki><nowiki><br>## old (not updated to PTP 7.0 testing) - remove ## if you update this and/or confirm you are still testing this</nowiki> <br>  
  
 
----
 
----

Latest revision as of 13:56, 24 May 2013

Test Plan for PTP 7.x Release

This plan describes the tests that will be undertaken to verify the 7.x series of PTP releases - Eclipse 7.0.0 will be available June 26, 2013 with the Eclipse Kepler (4.3) Simultaneous release.

Test Setup

The following steps should be carried out prior to testing PTP. Refer to the release notes for the appropriate PTP version if necessary.

  1. Make sure you have Java 1.6 or later
  2. Start with a fresh Eclipse installation
  3. Use a new workspace for testing (or remove old testing workspaces)
  4. Download and install the package "Eclipse for Parallel Application Developers" package
  5. (Optional, Remote only?) install PTP server components using instructions from the 7.0 release notes.
  6. Launch Eclipse on the test machine.
  7. If you require an MPI program for testing, use the following code:
#include <stdio.h>

#include <mpi.h> 
int main(int argc, char *argv[]) 
{ 
  int i, rank; 
  MPI_Init(&argc, &argv); 
  MPI_Comm_rank(MPI_COMM_WORLD, &rank); 

  for (i = 0; i < 10; i++) 
  { 
     printf("hello from %d loop %d\n", rank, i); 
     sleep(1); 
  } 

  MPI_Finalize(); 
  return 0; 
}

Test Iterations

The following dates show the final build dates for the RC builds (+5 day). Eclipse platform is built on +0 day (a Friday). PTP is +3 which means that its build is completed on the +3 day (following Wednesday). Testing can begin using the Kepler aggregation site (http://download.eclipse.org/releases/staging) on +4 day (watch email) and later. The EPP build (e.g. Parallel Package) is generally available at the end of the +5 day (Friday), but official EPP testing can begin on the EPP day (+4) once the packages have been announced.

Testing on RC4, even though it is the "final" build, is still useful as any bugs can still be fixed in future bug fix releases of PTP, or Eclipse Kepler service releases (SR1, SR2). However, these fixes will not be included in the initial Kepler release (June 26).

  • M7 May 10
  • RC1 May 24
  • RC2 May 31
  • RC3 June 7
  • RC4 June 14
  • Release date for Kepler - June 26

Testers

Please add your name to this list, remove the comment: "(remove this if participating in 7.0)" and add a general comment to your general field of expertise/intended testing here 

  • Greg Watson - General, debugger
  • Beth Tibbitts - General, PLDT, Feedback, Help, Install
  • Dave Wootton - IBM PE/LL
  • Wyatt Spear - ETFw, TAU
  • Jeff Overbey - Photran
  • Jay Alameda (remove this if participating in 7.0)
  • Galen Arnold 
  • Rui Liu - Feedback
  • Chris Navarro - General, ETFw
  • Roland Schulz (remove this if participating in 7.0)
  • John Eblen - Sync
  • Brian Watt - LSF
  • Hari Krishnan (remove this if participating in 7.0)
  • Brandon Gibson (remove this if participating in 7.0) - GIG,GEM
  • Zhi Ming Wang - IBM Platform MPI

Test Matrix

The following test matrix shows who will be testing each component on the different supported architectures. Note that because PTP is client/server, you should list both the client and server architectures for each component being tested. For example, if you are testing PE on a Mac OS X x86 client and an AIX backend, you should list both these architectures.

When you find bugs, please open a bug report against the relevant component.


Color Key: RM / target platforms Other technical features Misc things to test

 

  Linux x86* Linux x86_64 Linux PPC Mac 64 Win Win 64 AIX***
Client (Please everyone
list here which clients
you will/can test in 
general)
 ??

Zhi Ming Wang

Galen Arnold


 Beth, Greg  ??  ??
Grid Engine  ??

 ??  ??  ??
Open MPI ##   Galen  ??  ??
 ??
MPICH2  ??  ??
 ??
 ??
PE/LL
 Dave
(client)
 Dave
(server)


 Dave
(client)
 Dave
LL (BG)






PBS  ??



 ??
PBS (BG)  ??



 ??
LSF - Brian
(remote client;
local client;
server)
- - Brian
(remote client)
- -
IBM Platform MPI Zhi Ming Wang
(client)
Zhi Ming Wang
(client and server)
- - Zhi Ming Wang
(client)
Zhi Ming Wang
(client)
-
SLURM  ??  ??

J??

SLURM (BG)






TORQUE
Galen





  Linux x86* Linux x86_64 Linux PPC Mac 64 Win Win 64 AIX***
Debugger  ??  ??
 Greg
 ??
PLDT - C/C++  ??  ??
 Beth(R,L)  ??  ??
PLDT - Fortran  ??

 ??  ??  ??
RDT + RSE
 ??




RDT - Remote Projects
 ??


 ??
RDT - Sync Projects
John
 ??
 Greg
 ??
Photran Jeff

Jeff Jeff Jeff
ETFw (Core)  ??  Wyatt



 ??
ETFw (Feedback) Rui Rui  ??  ??  ??

ETFw (TAU)  ??  Wyatt



 ??
GEM+GIG  ??  ??
 ??


Error Parsers  ??

 ??  ??  ??
Env Mgmt  ?? Galen
 ??  ??  ??
SysMon  
     
Linux tools (LT) Galen
Install, Update


Beth


Help


Beth


PTP 6.0 Testing page
?? Name was here for 6.0 testing, not updated for 7.0
* Only the GTK 2 version of Eclipse will be tested
*** AIX testing is for the server side only.
α Limited testing only
(client) indicates that eclipse runs here
(server) indicates remote target runs here
(R) will test remote usage
(L) will test local usage
(LT) linux tools - test at least that the components are present and should work as they do elsewhere<br>## old (not updated to PTP 7.0 testing) - remove ## if you update this and/or confirm you are still testing this


Test Outlines

Initial overview of some features to be tested:

  • Install & Update: install parallel package, try update scenarios from & to different RCs/releases, make sure feature names, versions, providers, ids, etc are correctly set in installation information for each of the features (Beth)
  • Help: bring up help, make sure the pieces are all there, make sure topics are up to date, any version numbers referenced are correct, make sure links work between help docs (Beth)

Back to the top