Revision as of 21:12, 1 March 2012

addRepoProperties

Introduction and Overview

There is a tool in wtp releng that can modify p2 repository properties. This is especially useful for modifying these properties "after the fact", such as to give a final name to a repo, change or remove the p2.mirrorsURL value after a repository has been moved, etc.

While it is in the WTP code repository, it has been used for various things in Orbit and the yearly Simultaneous Release as well, so moderately reliable.

The tool can be used (or copied) by any project, but if you do, test well, on local test repos first, and early in dev cycle, and "use at your own risk" as it is not a fully supported API or tool with unit tests, etc. It uses only p2 APIs so should work with about any version of Eclipse SDK.

Getting or installing

Getting Source

The source code itself is in the cvs repository /cvsroot/webtools in a module under webtools.releng/plugins/, the module is named org.eclipse.wtp.releng.tools (that is, that's what you would check out as your Eclipse IDE project).

The feature used when building it is similar, but under webtools.releng/features/, and named org.eclipse.wtp.releng.tools.feature.

Installing from releng repo

To install an already built version into your IDE or SDK, you can use the repository at

http://download.eclipse.org/webtools/releng/repository/

And install the "Releng Tools Feature", its ID is org.eclipse.wtp.releng.tools.feature and at the time of this writing at the 1.2.0 level.

In install with p2 Director, you could use something similar to

 eclipse/eclipse \
    -application org.eclipse.equinox.p2.director \
    -noSplash -consolelog -debug -console \
    -repository \
 http://download.eclipse.org/webtools/releng/repository/ \
    -installIUs \
    org.eclipse.wtp.releng.tools.feature.feature.group

General Usage and Examples

In general, this tool operates directly on the artifacts repository, typically the "leaf" version (i.e. simple repository, not composite) where your "artifacts.jar" file is. You must have write access to that repository and use the absolute file path (i.e. not accessed over http or anything).

The parameters are all specified with -D system properties passed to the VM (currently).

The repository location is the only parameter that required. For most of the rest, if not specified at all, then any existing values are not changed. If specified with an empty string, this is taken as an indication to remove the property (i.e. doesn't just change the value to an empty string).

General Setup

After actually installing the tools into Eclipse SDK, the tool is typically invoked with a script such as the following ... though you should be able to run it from your IDE for local testing. I give this example script here, just for illustration, then we'll focus on the properties and different examples.

#!/usr/bin/env bash
BUILD_HOME=${HOME}/testbuildhome
JAVA_6_HOME=${HOME}/jdks/ibm-java-x86_64-60
APP_NAME=org.eclipse.wtp.releng.tools.addRepoProperties
devworkspace="${BUILD_HOME}"/addRepoPropertiesWorkspace
devJRE=${JAVA_6_HOME}/jre/bin/java
# remember, the '&' should NOT be unescaped here ... the p2 api (or underlying xml) will escape it. 
devArgs=" -DartifactRepoDirectory=/tmp/testartifactrepo/ \
    -Dp2ArtifactRepositoryName=ServiceRelease2Artifacts \
    -Dp2MirrorsURL=http://www.eclipse.org/downloads/download.php?format=xml&file=/project/releases/repository/ \
    "

echo "   cmd:          " $0
echo "   APP_NAME:     " $APP_NAME
echo "   devworkspace: " $devworkspace
echo "   devJRE:       " $devJRE
echo "   devArgs:      " $devArgs
echo
$devJRE -version
echo

eclipse/eclipse  -debug -nosplash -consolelog -console \
   -data $devworkspace --launcher.suppressErrors -application ${APP_NAME} \
   -vm $devJRE -vmargs $devArgs

Example of changing repo name and p2.mirrorsURL

From the example above, note the three properties specified for this run, via -D:

artifactRepoDirectory=/tmp/testartifactrepo/ 
p2ArtifactRepositoryName=ServiceRelease2Artifacts 
p2MirrorsURL=http://www.eclipse.org/downloads/download.php?format=xml&file=/project/releases/repository/

Assuming there is a valid artifact repo in /tmp/testartifactrepo the output of the run would look something like the following:

INFO: artifact repository directory set from 'artifactRepoDirectory': /tmp/testartifactrepo/
INFO: metadata repository directory set from 'metadataRepoDirectory': null
INFO: No metadata repository was specified. If desired, set the system property 'metadataRepoDirectory'.
INFO: the artifact repository had existing name: Indigo artifacts
INFO: p2ArtifactRepositoryName value set from 'p2ArtifactRepositoryName': ServiceRelease2Artifacts
INFO: the repository had existing mirrorURL: http://www.eclipse.org/downloads/download.php?format=xml&file=/releases/indigo/201202240900/aggregate/
INFO: mirror URL value set from 'p2MirrorsURL': http://www.eclipse.org/downloads/download.php?format=xml&file=/project/releases/repository/
INFO: the repository had existing statsURI: http://download.eclipse.org/stats/releases/indigo
INFO: stats URI value set from 'p2StatsURI': null
INFO: p2StatsURI was not specified. Any existing values not changed.
INFO: No artifacts requested to be tracked
INFO: repository rewritten

Notice the "INFO" is telling you what it found and did, what existing values were found, and what they were changed to. At the end, it says "repository rewritten" to make explicit it found changes to make and did re-write the repository file.

If the exact same job were run again, on the already changed repository, the output would be as below Notice the application knows now sometimes prints the "found" and "existing" values "were the same". So, it didn't change anything, so does not "rewrite" the repository. It calls that a "warning" under the assumption you ran a job to "change properties" so you probably expected something to happen.

INFO: artifact repository directory set from 'artifactRepoDirectory': /tmp/testartifactrepo/
INFO: metadata repository directory set from 'metadataRepoDirectory': null
INFO: No metadata repository was specified. If desired, set the system property 'metadataRepoDirectory'.
INFO: the artifact repository had existing name: ServiceRelease2Artifacts
INFO: p2ArtifactRepositoryName value set from 'p2ArtifactRepositoryName': ServiceRelease2Artifacts
INFO: new value and existing value of artifact repository name are the same
INFO: the repository had existing mirrorURL: http://www.eclipse.org/downloads/download.php?format=xml&file=/project/releases/repository/
INFO: mirror URL value set from 'p2MirrorsURL': http://www.eclipse.org/downloads/download.php?format=xml&file=/project/releases/repository/
INFO: new value and existing value of mirrorURL are the same
INFO: the repository had existing statsURI: http://download.eclipse.org/stats/releases/indigo
INFO: stats URI value set from 'p2StatsURI': null
INFO: p2StatsURI was not specified. Any existing values not changed.
INFO: No artifacts requested to be tracked
WARNING: repository was not rewritten