Parallel Tools Platform FAQ
- 1 Q: How do I download PTP?
- 2 Q: How do find out more about Synchronized Projects and System Monitoring?
- 3 Q: What version of Eclipse and CDT do I need?
- 4 Q: What version of MPI do I need to run PTP?
- 5 Q: What platforms and runtimes are supported by PTP now?
- 6 Q: How do I install Open MPI?
- 7 Q: How do I build PTP myself?
- 8 Q: How do I ask questions about PTP?
- 9 Q: How do find out more about PTP?
- 10 Q: What's the most recent version of PTP?
- 11 Q: How do I install the most recent released version of PTP?
- 12 Q: How do I update my PTP within the package "Eclipse IDE for Parallel Application Developers" ?
- 13 Q: I want to live a bit on the bleeding edge. How do I install a more recent PTP build, e.g. to get a bug fix ?
- 14 Q: When I launch a parallel job how do I stop it from building everything in my workspace ?
- 15 Q: How do I create my own Target System Configuration (TSC) for the scheduler on my remote system ?
- 16 Q: How do I customize the new (JAXB) Configurable Resource Manager?
- 17 Q: How do I enable the Eclipse menu icons to show in Linux with GTK?
- 18 Q: How do I use PTP to connect to a remote system via an intermediate host (multi hop)
- 19 Q: Why should a general project be first converted to a C/C++ project and then to a synchronized project ?
- 20 Q: Eclipse complains "No such file or directory" when attempting a remote build for a managed project
- 21 Q: Eclipse doesn't seem to find commands for [compiler, make, ...]
- 22 Q. When dealing with my remote system I see an error "Invalid java version or java not installed on "<connection name>""
- 23 Q: How can I get the C/C++ indexer to use my remote include paths in a synchronized project?
- 24 Q: My remote or synchronized project doesn't find the remote environment variables correctly (Interactive vs. non-interactive shell)
- 25 Q: I get an 'Internal Error' when the debugger starts on Mac OS X (Mountain) Lion
- 26 Q: I get the message 'Unable to determine gdb version' when trying to debug a program
- 27 Q: How do I debug the server part of PTP's system monitoring capability?
- 28 Q: What do I do when i get "Failed to Create the Java Virtual Machine" launching on win32?
Q: How do I download PTP?
PTP can now (as of 6.0, June 2012) be installed in two ways:
- from the all-in-one package "Eclipse for Parallel Application Developers" on the Eclipse downloads page
- or installed into an existing eclipse via the Eclipse Installation Manager (Help > Install new software...).
See the PTP download page; check regularly there for new releases, too. The current released version of PTP is 6.0.x.
See the PTP 6.0 release notes for detailed instructions on how to install PTP.
Q: How do find out more about Synchronized Projects and System Monitoring?
There are other FAQ pages with Frequently asked questions about
Q: What version of Eclipse and CDT do I need?
PTP 6.0 is designed to work with Eclipse 4.2 (Juno) and CDT 8.1.x. (The all-in-package referenced above now takes care of this for you.)
PTP 5.0 is designed to work with Eclipse 3.7.x (Indigo) and CDT 8.0.x. (The all-in-package referenced above now takes care of this for you.)
PTP 4.0 is designed to work with Eclipse 3.6.x (Helios) and CDT 7.0.x.
PTP 3.0 is designed to work with Eclipse 3.5.x (Galileo) and CDT 6.0.2.
Q: What version of MPI do I need to run PTP?
PTP supports the following MPI runtimes:
- Open MPI 1.2.x, 1.3.x, or 1.4.x ... and higher.
- MPICH2 1.0.6p1
- IBM's Parallel Environment (PE)
The most recent OpenMPI (generally) is recommended for the most recent release of PTP, although it may work with older releases.
For the Parallel Language Development Tools only, there should be no difference between the different versions of MPI, such as OpenMPI and LamMPI. You just need to configure your project to be built using mpicc rather than gcc (for MPI releases that require that; most do), and to (optionally) specify the include path to the MPI header files. This should be described in the PLDT help.
Q: What platforms and runtimes are supported by PTP now?
The current release of PTP runs on Linux, MacOS X, and Windows. PTP only supports target systems running Linux, MacOS X, and some kinds of Unix (e.g. AIX).
The Parallel Language Development Tools will run anywhere Eclipse and CDT will run. It may require a version of MPI (specifically, its header files) to aid in the search for MPI artifacts. And an OpenMP header file, if OpenMP analysis is needed. This means you can develop and analyze source files but you can't launch them.
The Remote Development Tools can be used on Linux, MacOS X, and Windows.
Q: How do I install Open MPI?
You may already have it installed. Try running the following command and check the output:
If this doesn't work, download the latest version from the Open MPI site.
Unpack the distribution and run the commands (note that you may have to add extra options to configure to suit your local site - see the Open MPI help documentation for more information):
./configure --prefix=/path/to/your/ompi/install make make install
At this point it's a good idea to run a small mpi program to test you have installed Open MPI correctly.
mpicc -o testMPI testMPI.c mpirun -np 2 testMPI
Q: How do I build PTP myself?
See the PTP Environment Setup instructions
Q: How do I ask questions about PTP?
Subscribe to the PTP Mailing lists, especially ptp-user, and ask questions there. This is an excellent place to ask new-user questions. The ptp-user list is watched by most of our PTP developers as well as many users, and you can share in their experience. See http://www.eclipse.org/ptp/mailing_lists.php
Q: How do find out more about PTP?
- Read the PTP Help documentation from the PTP Website or download it and read the help within your PTP installation.
- Download slides from previous PTP tutorials
- Ask questions on the mailing lists: See http://www.eclipse.org/ptp/mailing_lists.php
Q: What's the most recent version of PTP?
The current released version is 6.0.x. (Fall 2012 )
See the announcements on http://eclipse.org/ptp which should indicate the latest release number. As of December 2012 this is 6.0.4.
The most accurate latest release number is whatever is found on the update site at http://download.eclipse.org/tools/ptp/updates/juno
Q: How do I install the most recent released version of PTP?
There is an all-in-one installation package, and update sites for you to install PTP into your own installation of Eclipse.
The all-in-one installation is the easiest way to install PTP and it can be installed
- from the all-in-one package "Eclipse for Parallel Application Developers" on the Eclipse downloads page
There are two update sites:
- The Eclipse Juno update site http://download.eclipse.org/releases/juno contains all the Eclipse projects (as of March 1, 2013 it contains PTP 6.0.4)
- The PTP-specific update site http://download.eclipse.org/tools/ptp/updates/juno may have a more recent release (As of March 15, 2013 it contains PTP 6.0.5)
- Update Sites
- The Juno update site (http://download.eclipse.org/releases/juno) contains the last release of PTP that was built into the Eclipse general update site. Eclipse Juno updates are released only in September and February. This update site (a.k.a. software repository) is enabled by default when you install Eclipse Juno (a.k.a. 4.2).
- Help > Install New Software.... and install PTP from there
- Help > Check for Updates will find the updates for all your installed features that are found there.
- PTP maintains its own PTP-specific update site with the most recent release of PTP. Bug fix releases can be more frequent than the main Eclipse.
You must enable the PTP-specific update site before the updates will be found.
- Enable the PTP-specific update site
- Help > Install new software...
- Click Available Software Sites link
- Enable/check the PTP site:
- If you had this checked before, and a release happened recently, hit the 'Reload' button while this site is selected. Or if things just don't seem to be refreshing correctly: It can't hurt!
- Choose OK and then Cancel to return to the Eclipse workbench, and ...
- Now do the update
- Select Help > Check for updates
- Follow prompts like a normal installation
- Select Help > Check for updates
- Enable the PTP-specific update site
Q: How do I update my PTP within the package "Eclipse IDE for Parallel Application Developers" ?
Q: I want to live a bit on the bleeding edge. How do I install a more recent PTP build, e.g. to get a bug fix ?
Go to the PTP builds page and find the page for your release (e.g. if you have 6.0.x, find the page with the largest value of x) and download the archive file (ptp-master-xxx) then use that in the Help > Install New Software... dialog.
Q: When I launch a parallel job how do I stop it from building everything in my workspace ?
Open Preferences (Window > Preferences or on a Mac, Eclipse > Preferences), Open Run/Debug / Launching
Under "Run/Debug", select "Launching" and Uncheck "Build (if required) before launching"
Q: How do I create my own Target System Configuration (TSC) for the scheduler on my remote system ?
See the next Q - where TSCs are referred to as "Resource Managers"
Q: How do I customize the new (JAXB) Configurable Resource Manager?
(Note: Target System Configurations were previously called "Resource Managers" in previous releases of PTP. Not all terminology has been changed here.)
A detailed guide to the XML Schema for the new Configurable Resource Manager, along with an introductory tutorial slide-set demonstrating some simple modifications to an existing XML definition, are now available at PTP/resource-managers.
To take an existing JAXB-based resource manager (a.k.a. TSC) and be able to tweak it, you can import it and change the xml data yourself. To do this:
- Go to Import..., then open Resource Managers>Resource Manager Definition From Plug-in.
- Choose the Resource Manager you want to clone (e.g. PBS-Generic-Batch) RM from the combo.
- This should create a new project in your workspace called resourceManagers.
- Expand the resourceManagers folder created.
- Double click on the xml file to open it in an editor.
- Change the name in the xml attribute "name=" to be something unique.
- Example of a PBS change: Go to the end of the file, and change line 828 from '<monitor-data schedulerType="TORQUE">' to '<monitor-data schedulerType="PBS">'.
- Save the file.
Now, to use the new TSC/Resource Manager
- Launch a Parallel Application and select your new TSC.
If you're planning to change the XML after you have used it to create a RM,
- Go to Preferences then select Parallel Tools>Resource Managers> Configurable Resource Manager
- Check the "Always load XML from URL" option.
- Stopping and restarting the RM will then reload the new definition.
- http://wiki.eclipse.org/PTP/workshops/September_2012 includes several presentations on related topics
See this bug: https://bugs.eclipse.org/bugs/show_bug.cgi?id=293720
Q: How do I use PTP to connect to a remote system via an intermediate host (multi hop)
You would first create the ssh tunnel using a command such as:
ssh -L 22222:<target-host>:22 <intermediate-userid>@<intermediate-host>
where <intermediate-host> is the host name of the intermediate system and <target-host> is the host name of the target system. The first port number (22222) can be any port number greater than 1024 that is not already being used on your local system. Use <intermediate-userid>@ if the userid is different from your local system. The second port number must be 22. Once a connection is established to <intermediate-host>, you will need to leave this session connected while you're using PTP. In the resulting session, if you issue the command 'hostname' you should see the value for the intermediate-host system.
Next, when you create a new connection - specify the host name as 'localhost'. Click on the 'Advanced' button, and change the port number from 22 to the number you specified in the command above.
Use this same connection when configuring a remote or synchronized project.
As a confirmation of the tunneling being set up correctly, you can do the following in another terminal window:
ssh -p 22222 <target-userid>@localhost
And in the resulting session, the command 'hostname' should match the target-host system.
Other interesting things to type
ssh -p 22222 userid@localhost hostname ==> prints the hostname of the target destination host ssh -p 22222 userid@localhost which git ==> confirms that git is in your path
Q: Why should a general project be first converted to a C/C++ project and then to a synchronized project ?
The situation might occur if a git repository has been imported into Eclipse as a general project, but should now be converted to a synchronized C/C++ or Fortran project. There are two wizards available, one for conversion to a C/C++ project and one for conversion to a synchronized project. So these have to be called one after another, but the order matters.
The wizard for converting to a synchronized project shows an extra page for linking sync configurations to build configurations, if applied to a C/C++ or Fortran Project. If not dealt with on this wizard page, the linking of sync to build configurations would need to be added manually to the project settings. Thus the following recipe provides the smoothes path to a synchronized C/C++ or Fortran project.
- Convert to a C/C++ project.
- Convert to a Fortran project, if applicable
- Add an additional build configuration, if there will be different build configuratuions locally and remotely.
- Convert to a synchronized project, linking the sync configurations to the given build configurations.
Q: Eclipse complains "No such file or directory" when attempting a remote build for a managed project
Managed projects create their build directories. By default they are called "Debug_remote" or "Release_remote." These are created locally and then replicated to the remote host. Please check your replication filter settings and make sure that at least the makefile and make include files in these directories are being transferred to the remote side.
Q: Eclipse doesn't seem to find commands for [compiler, make, ...]
If you get an error, e.g. in the console, saying something cannot be found, such as:
error /bin/sh: ifort: not found make: *** [test.o] Error 127
Then it likely means that the required command cannot be found in your PATH environment variable, e.g. ifort in this case.
If you are starting Eclipse from a shell make sure the path to the command is specified for the PATH environment variable in your login script. (Note: reference interactive shell vs. non-interactive shell below in next FAQ item)
If you are starting Eclipse from a Linux window manager (Gnome, KDE, etc.) then consult your window manager documentation for information on how to set environment variables.
If you are starting Eclipse from the OS X window manager, the solution depends on the version of OS X.
For OS X 10.7 (Lion) and earlier:
PATH must be set by creating a file called
environment.plist in a directory called
.MacOSX in your home directory.
The file should look like this, with [path_from_shell] replaced with the correct path, such as that obtained by the command "echo $PATH" in your shell.
<?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE plist PUBLIC "-//Apple Computer//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd"> <plist version="1.0"> <dict> <key>PATH</key> <string>[path_from_shell]</string> </dict> </plist>
For OS X 10.8 (Mountain Lion):
environment.plist method no longer works. Instead you have two choices:
- Modify the environment for all applications globally. This is done by using the command 'launchctl setenv key value'. You will need to restart the application for the new environment to be picked up. Note that this only lasts until the next reboot. For a permanent fix, edit
/etc/launchd.confand add a 'setenv' line.
- Modify the environment for the specific application. This involves editing the application
Info.plistand adding an 'LSEnvironment' key. See LaunchServicesKeys for more information.
Q. When dealing with my remote system I see an error "Invalid java version or java not installed on "<connection name>""
See the other FAQ items about environment variables. Your userid isn't finding Java in your path.
Remote projects (not synchronized projects) need java on the remote system in order to start the indexing service. So make sure java is in your PATH, and it is accessible from a non-interactive shell (see next FAQ item).
Q: How can I get the C/C++ indexer to use my remote include paths in a synchronized project?
Even if you have your project set to use a remote build configuration that contains the paths to the remote include files, the C/C++ indexer may find include files on the local (client) machine instead of the remote machine.
The problem here is the settings for the indexer itself. To fix this, you must set the indexer to use the active build configuration, instead of the default, which is usually the local build config. A further complication is that because of a bug in the indexer project settings, any change you make to it will not be preserved when you restart Eclipse (see bug205299). Fortunately, there is a simple work around: use the global settings for the C/C++ indexer instead of the project-specific settings; the global setting is preserved across restarts of Eclipse. To change this setting, use Window->Preferences->C/C++->Indexer then check "Use active build configuration".
Q: My remote or synchronized project doesn't find the remote environment variables correctly (Interactive vs. non-interactive shell)
Note that communication with your remote host is done via ssh. Even if you are connecting back to your local machine to run/debug locally, make sure you do this.
Remote Tools needs the proper environment variables in order to find java, compiler, make, etc.
Your environment may be set up correctly for an interactive shell but not for a non-interactive shell. You probably want to set up the same environment for an interactive and non-interactive shell. For example, for bash, there are at least two files ~/.profile and ~/.bashrc. Make sure you know which ones your system uses. Naturally this depends upon what shell you are running.
- ~/.profile or .bash_profile– read by ssh in interactive shell on login
- ~/.bashrc – read by ssh in non-interactive shell on login
Make sure the non-interactive shell is set up properly. Perhaps helpful reference(s):
- Setting SSH Remote Host Environment variables
- Try this from the command line of the machine eclipse is on:
- ssh userid@remotehost command (e.g.
ssh beth@myRemoteSystem.com ls)
- try the command you are trying to do that is giving you problems, instead of 'ls'
- ssh userid@remotehost command (e.g.
An alternative (works for ksh for at least some of us) is to do the following:
- Modify sshd_config to have "PermitUserEnvironment yes" and reload sshd to use it. You'll need root access to do this.
- Added ~/.ssh/environment to your userid to contain the java path, for example, PATH=/usr/local/bin:/bin:/usr/bin:/opt/java/jre/bin
More notes from ptp-dev discussions
- It depends on which shell you use on the remote machine. Usually the default for Linux is set to bash, but some people like ksh, tcsh, etc. and have their default shell set to that.
- tcsh uses ~/.tcshrc, and if that doesn't exist, it tries ~/.cshrc
- ksh ... appears to use the same file as bash (and sh) - .profile
- bash is recommended!
- Most of the above depends on system configuration for non-interactive shells. Most have it configured to read ~/.bashrc, but not all, and without this setup you may not be able to set the environment.
- Pure Remote Projects (not synchronized projects) need java on the remote server. Here's how to test:
- from your workstation, tunnel via ssh to the remote machine:
ssh userid@myRemoteSystem.com which java ssh userid@myRemoteSystem.com java -version
- http://www.understudy.net/custom.html - several different shells described, including interactive vs. login shells
Q: I get an 'Internal Error' when the debugger starts on Mac OS X (Mountain) Lion
On Mac OS X Lion (and later) you may see an error similar to the following when you try to start the debugger locally:
Error on tasks: 0 - Internal Error Reason: Debugger error: Unable to find Mach task port for process-id 51470: (os/kern) failure (0x5).
This is because Lion has introduced new security requirements for gdb to work. Note that gdb is installed by default as /usr/libexec/gdb/gdb-i386-apple-darwin. The /usr/bin/gdb command is just a script that invokes this executable.
Execute the following commands (this assumes that your user is in the procmod group, check using the 'id' command):
chgrp procmod /usr/libexec/gdb/gdb-i386-apple-darwin chmod g+s /usr/libexec/gdb/gdb-i386-apple-darwin
Running the following command appears to work:
sudo DevToolsSecurity -enable
Q: I get the message 'Unable to determine gdb version' when trying to debug a program
Make sure you have the "Path to backend debugger" preference set to the path to the gdb program, not the sdm. See this bug for more details.
Q: How do I debug the server part of PTP's system monitoring capability?
If the Active Jobs view is empty when you know jobs are running on the system, perhaps the commands queried from the monitoring system are not successful.
1. On the remote machine, go to the ".eclipsesettings" directory, located in your home directory
2. Create a file called ".LML_da_options" containing a single line "keeptmp=1" (no quotes).
3. Restart the monitor.
4. You should now find a directory called "tmp_<hostname>_<pid>" in the ".eclipsesettings" directory. It should contain an error log file, plus a bunch of other files. Check these files to see if you can see the cause of the error.
5. Remember to remove the ".LML_da_options" file once you have finished.
See also PTP System Monitoring FAQ
Q: What do I do when i get "Failed to Create the Java Virtual Machine" launching on win32?
The JVM cannot allocate enough memory with current eclipse settings. FInd your eclipse.ini file (in the same directory as the eclipse executable), and in the line e.g. -Xmx2048m ==> change it to a smaller number e.g. to -Xmx512m or -Xmx768m or -Xmx1024m
It could be that your eclipse will run out of memory on a machine with a relatively small amount of RAM. (Need to publish suggested memory minimums.)
Note that a 32bit windows app only can have 2GB memory total. Changing the -Xms and -Xmx values to:
may fix it (assuming your machine tolerates *that* much). Older machines, or with less memory, may need to go down to
But you risk OutOfMemoryException later