Jump to: navigation, search

Difference between revisions of "Equinox/p2/p2.mirrorsURL"

< Equinox‎ | p2
(How to add?)
(How to add?)
Line 33: Line 33:
 
an xsl template, like this [http://dev.eclipse.org/viewcvs/viewvc.cgi/org.eclipse.mylyn/org.eclipse.mylyn.releng/bin/p2.xsl?view=markup&root=Mylyn_Project p2.xsl] from the Mylyn project). When manually editing <code>artifacts.xml</code> add the property to the existing list of properties right at the top of the document. Don't forget to update the <code>size</code> attribute of the enclosing <code><properties></code> element.
 
an xsl template, like this [http://dev.eclipse.org/viewcvs/viewvc.cgi/org.eclipse.mylyn/org.eclipse.mylyn.releng/bin/p2.xsl?view=markup&root=Mylyn_Project p2.xsl] from the Mylyn project). When manually editing <code>artifacts.xml</code> add the property to the existing list of properties right at the top of the document. Don't forget to update the <code>size</code> attribute of the enclosing <code><properties></code> element.
  
Others have reported that the <code>p2.mirror</code> ant task can be used to insert properties like p2.mirrorsURL while mirroring the build output to the final destination. The following two snippets may serve for inspiration:
+
Others have reported that the [http://help.eclipse.org/indigo/index.jsp?topic=%2Forg.eclipse.platform.doc.isv%2Fguide%2Fp2_mirror.html p2.mirror ant task] can be used to insert properties like p2.mirrorsURL while mirroring the build output to the final destination. The following two snippets may serve for inspiration:
 
<source lang="xml">
 
<source lang="xml">
 
<!-- generate template with proper mirror urls -->
 
<!-- generate template with proper mirror urls -->

Revision as of 13:31, 18 February 2012

Disclaimer: this page is not authored by a p2 expert, I merely reproduced some information which I found difficult to collect -- Stephan

Enabling your repository to leverage mirrors

The p2.mirrorsURL should be added to your metadata so that p2 will see the list of available mirrors to choose during installation.

Where to add?

Adding this property to artifacts.xml is sufficient, since p2 uses a list of mirrors while retrieving artifacts, not the metadata itself. Obviously, artifacts.jar must be updated or replaced after changing artifact.xml.

Should composite repos be treated, too, or just their children (leaves)?

Just the leaves. No need to to specify the property in compositeArtifacts.xml/jar.

What to add?

The property has the following structure:

  <property name="p2.mirrorsURL" 
          value="http://www.eclipse.org/downloads/download.php?file={repository_path}&amp;format=xml&amp;protocol=http"/>
  • replace {repository_path} with the path where your artifacts.jar sits on download.eclipse.org,
    e.g., for http://download.eclipse.org/eclipse/updates/3.6/R-3.6.2-201102101200/artifacts.jar the path would be /eclipse/updates/3.6/R-3.6.2-201102101200
  • yes, &amp; is 5 characters
  • the last part, &amp;protocol=http is important, since it restricts the list of mirrors to those that support http. Monitor bug 349679 for status/progress on p2 working with ftp sites. (In general, such as for zip files linked on download pages, and similar, the 'protocol' parameter is optional for the download.php script and when omitted both http and ftp mirrors are returned).

This p2.mirrorsURL property will tell p2 to use the given URL to fetch a list of available mirrors (in xml format).

How to add?

If you use a site.xml the word goes that this is where you should specify this property. The Equinox/p2/Publisher should automatically transfer this information into your metadata.

If you don't use a site.xml you may consider manually editing artifacts.xml (which of course can be automated using, e.g., an xsl template, like this p2.xsl from the Mylyn project). When manually editing artifacts.xml add the property to the existing list of properties right at the top of the document. Don't forget to update the size attribute of the enclosing <properties> element.

Others have reported that the p2.mirror ant task can be used to insert properties like p2.mirrorsURL while mirroring the build output to the final destination. The following two snippets may serve for inspiration:

<!-- generate template with proper mirror urls -->
<copy
  file=".../template-artifacts.xml"
  tofile="${buildDirectory}/publishRepoTemplate/artifacts.xml">
  <filterset>
        ... specify string substitutions here ...
  </filterset>
</copy>
<!-- mirror to target (but only the bits that really changed) -->
<p2.mirror ...>
  <source location="..."/>
  <destination .../>
  <destination
    kind="artifact"
        compressed="true"
        name="${p2.repo.name.prefix} (Build ${buildId})"
        location="..."
        append="true"
        format="${templateRepoUrl}"/>
  ...
</p2.mirror>

These snippets were extracted from this build.xml from the gyrex project.

How to test?

Warning2.png
Mirror invalidation
It seems that by modifying artifacts.jar all mirrors of the containing directory will be invalidated. Thus after updating artifacts.jar the mirrors need to catch up before the change can be tested.


First, you may paste the full URL you specified as the value into your browser (now collapse &amp; to &). The result should be an XML file with lots of mirror URLs. Pasting one of these URLs into the browser should in turn take you to the directory holding your artifacts.jar and friends.

Secondly, to test whether install successfully uses mirrors you may use the following options file (stored, e.g., as /tmp/p2options):

 org.eclipse.equinox.p2.core/debug=true
 org.eclipse.equinox.p2.core/artifacts/mirrors=true

(The first line generally enables debugging p2, the second line selects specific tracing for mirror selection)

Then you may want to unpack a fresh Eclipse package and change into the eclipse directory.

Finally, use the Equinox/p2/Director application for installing your feature using this command line:

 ./eclipse -consoleLog -noSplash -debug /tmp/p2options -application org.eclipse.equinox.p2.director \
       -repository http://download.eclipse.org/myproject/myrepo \
       -installIU org.eclipse.myproject.myfeature.group

This should install your feature and print to the console where each artifact was downloaded from. If p2.mirrorsURL is not properly configured no such messages will be shown.

Conversely, you can disable the automatic mirror selection mechanism by setting the VM argument eclipse.p2.mirrors to false (remember that vm args have to be last on the command line preceded by the switch -vmargs).

Moving a repo to archive.eclipse.org

Another situation where redirected downloads are desirable is when a repo is moved from download.eclipse.org to archive.eclipse.org. For files references using the Find a Mirror script (http://www.eclipse.org/downloads/download.php?file=/path/to/a/file.zip) moving to archive is transparently handled by that script. This section is exploring how the same effect can be achieved for p2 repositories.

The obvious way might be through the use of p2.mirrorsURL, however, I couldn't get this to work -- Stephan.

The following strategy seems to do the job (although admittedly, not a candidate for beauty contests):

  • when moving everything to archive.eclipse.org keep a copy of all metadata (artifacts.jar and all those) on download.eclipse.org.
  • extract the .xml files and edit like so:
    for composite repositories
    Ok green.gif edit both compositeContent.xml and compositeArtifacts.xml:
    • simply change all relative paths to absolute paths pointing to http://archive.eclipse.org/something
    for leaf repositories
    Warn.gif edit artifacts.xml (this is the ugly, unofficial approach - use at your own risk):
    • remove any p2.mirrorsURL property (and decrease the size of the enclosing <properties> element accordingly).
    • in the <mappings> element replace all occurrences of ${repoUrl} with the archive path to your repo, like http://archive.eclipse.org/objectteams/updates/ot0.7
    • to be on the safe side increment the p2.timestamp value in the top list of properties

After editing put the .xml files back into their respective jar.

An alternative, cleaner strategy for leaf repositories has been discussed in bug 349141#c3:

Ok green.gif redirect using a composite repository as a proxy:
  • move repository as-is to archive (maybe should remove p2.mirrorsURL at this point?)
  • create new composite repository pointing to archive.eclipse.org/...