PTP/designs/remote/cdt

Adding Remote Build and Remote File System Support to CDT

Our objective is to provide remote support for the Parallel Tools Project in a way that is natural to the user. The approach we take is to extend the new emerging Eclipse File System (EFS) with support for remote file systems, and use RSE to run commands on the remote machine (see the evaluation). Most parallel application development uses either the CDT and Photran components, however neither of these components currently support EFS or remote building.

The Current Status

CDT has no support for EFS at all. Even support for locally linked resources, as a special example of EFS, is quite limited. For example, the standard make C projects do not support linked files. The following bugs are also identified:

• 136136 Build directory should not be restricted to workspace
• 70491 Invalid Include Path when "Link to Folder in the Filesystem"

And, also reference http://dev.eclipse.org/mhonarc/lists/cdt-dev/msg03059.html for the discussion of linked resources.

CDT also assumes that the source files are available locally and uses this fact when running the indexer. The build command is also assumend to be run locally and access a local filesystem.

What is Needed?

With EFS, projects or its component directories and files can be linked to different file systems, which can be local, remote, or virtual. The files and directories can be physically located at completely diverse places.

To support EFS while keeping the standard make builder, the CDT build has to be modified in the way that the files in the project can, when necessary, be replicated in a build directory (optionally on a remote build server) before the build command is invoked. The existing build directory of the C/C++ Build property can be exteded for this purpose and an additional property of build server can be added (see the picture).

The above process abstracts and covers many different cases. Some typical scenarios include, but not limited to:

• whole project on remote server: if the build machine is the same as the file server, then no replication is necessary; otherwise replicate.
• project with locally linked directories and files (linked to local file system): the files need to be replicated to a local build directory before invoking the build command.
• project with virtual file system (zip, for example): the files has to be replicated to a local build directory.

This will affect several other related components of CDT. Such components include the Indexer, Managed Make etc.

Roadmap to EFS Enablement for CDT

1. Modify the code to allow build directory outside of workspace (fix to bug 136136)
2. Modify CDT Project Creation/Conversion Wizard for EFS support
3. Add build server property to the build property tab and modify the code to launch build command on build server
4. Modify the affected components like Indexer and ManagedMake and fix those components [to be investigated]
5. Enable file replication before build to support other scenarios