Ant/How to add new Ant versions
|Mailing List • Forums • IRC • mattermost|
This wiki discusses the steps to add a new version of Apache Ant to the Eclipse platform. The intended audience is committers, but everyone is free to contribute versions.
- 1 How it works
- 2 Creating the Orbit bundle
- 3 Updating Platform Ant
- 4 Approval for use
- 5 Put it in Orbit
- 6 Testing and Test builds
How it works
Eclipse consumes Apache Ant from Orbit as a 'normal' Eclipse bundle rather than try to integrate Apache Ant as-is. Below is a quick overview of the process, with the following sections providing more details.
A quick overview of the process:
- Ant is taken from Apache site and converted to the Orbit bundle format.
- A CQ is opened to get legal approval to use the new version
- Once approved, the new version is added to Orbit
- Smoke testing and test builds are done
- Assuming no problems - the platform is updated
Creating the Orbit bundle
The first step is to create the new Orbit bundle that can be used in your workspace (or installed in your host) to test with. This section assumes you are familiar with the terminology of Eclipse bundles, using the PDE tools, testing / running JUnit tests and have read the relevant how-tos from the Orbit wiki about adding / configuring bundles.
The best way to see the expected shape of the Ant bundle is simply to look at an older (or current) version used by Eclipse. You can grab an older version from the CVS repository, but you will have to rename it in your workspace (or its name will collide with the new version you are trying to create). At the time of this writing the version used in Eclipse is 1.9.2, so you will want to check out the 1_9_2 branch of Ant from orbit.
Once in your workspace, the bundle will look like the following:
The important parts to note in the bundle are:
- about_files - contain all of the license files directly from Apache
- bin - contains all of the script files from the binary distribution of Apache Ant
- etc - contains all of the styles sheets for Ant tasks
- lib - contains all of the jar files from the binary distribution of Apache Ant
- source-bundle - contains the Orbit-formatted source bundle, whose content come from the source distribution of Apache Ant (more on this later)
The remainder of the files / folders are standard Eclipse bundle files which don't require special mention. Any of them that requires editing will be mentioned in the following sections.
Grab the new Apache Ant version
The first step to creating our new orbit bundle is grabbing the binary and source distributions of Apache Ant.
They can be found on their respective download pages:
Once you download the two versions, extract them some where convenient. Also take note the Apache download page mentions you might need special steps to extract the distributions due to really long file names.
Create the workspace bundle
With the latest version of Apache Ant acquired and an old version of the Ant bundle to compare to, lets create the new version in our workspace. A note here: it is a good idea to have no other bundles open in you workspace while you are working on Apache Ant. The reason for this is that Apache Ant is a low-level bundle and bringing it into your workspace / editing it seems to cause confusion in your target platform. So best to just keep all your other bundles closed while you create the new version.
- Create the
- Fill in the
MANIFEST.MFinformation as required. 'Id' is org.apache.ant, 'version' is 1.9.3_qualifier (for example), 'name' is Apache Ant and 'provider' is Eclipse Orbit. Make sure to also externalize these values for translation (you can use the PDE wizard for this).
- Add a bundle dependency on
MANIFEST.MF(do not include version constraints on it)
- Add a BREE of
MANIFEST.MFand click the
update classpath settingslink.
- Copy the
/about.htmlfile from the old version to the new version. Open it and change the date to the current date (update the copyright as needed), Update the version of Ant mentioned and update the link to the what's new for the current release.
- Copy all of the files from the
.settingsfolder of the old version into the
.settingsfolder of the new version
- Edit the build path properties and set the default output folder to be
- Copy the
/MANIFEST.MF/eclipse.inffile from the old version to the new version
- Copy the
build.propertiesfrom the old version to the new version (update the copyright as needed)
Thats it! At this point we have the complete bundle shape, all that remains is to add the updated Ant libraries / files.
Update the binary parts
First we will start with updating the binary parts of the bundle. This involves copying files from the binary distribution of Ant. To simplify
the steps I will assume the root of the binary distribution of Apache Ant to be
/binary. So for example when I talk about copying a file from the
I will refer to it like:
- Copy all of the files from the
/binary/binfolder to the
/binfolder of the project. These are a bunch of
*.sh, *.pl, *.py, *.bat and *.cmdfiles.
- Copy all of the
/etcfolder of the project. DO NOT copy the jar file.
- Copy the
/binary/etc/checkstylefolder (and all of its contents) to the
/etcfolder of the project.
- Copy all of the jar files from
/libfolder of the project. DO NOT copy any of the pom files or anything else, only the jar files.
- Open the MANIFEST.MF editor and go to the Runtime page. Now using the Add... button in the Classpath section, add all of the jar files from the
/libfolder to the classpath. Once that is done, use the Add... button in the Exported Packages section to export all of the
- Now open the
.classpathfile to confirm it contains all of the library entries like:
<classpathentry exported="true" kind="lib" path="lib/ant.jar"/>
- Open the project Java build path properties and go to the Libraries tab. Confirm all of the libraries are there. For each one of the libraries we want to make sure the source path is correct - to do so expand each library and edit the source attachment value. Each value is from the workspace and points to
/org.apache.ant/source-bundle/libsrc. After you are done setting the source paths, go to the Order and Export page and confirm all of the Ant libraries are checked (if not, do so).
- Reopen (or go to) the MANIFEST.MF editor and on the overview page hit the
update classpath settingslink. Now open the
.classpathfile and confirm you have all of the library entries like the following:
<classpathentry exported="true" kind="lib" path="lib/ant.jar" sourcepath="source-bundle/libsrc"/>
If everything checks out with the manifest and classpath, then we are done. If not go back through the steps to confirm they are all done.
Update the source parts
Next we update the source parts of the bundle. This involves copying files from the source distribution of Ant. To simplify
the steps I will assume the root of the source distribution of Apache Ant to be
/source. So for example when I talk about copying a file from the
I will refer to it like:
- Save the license text from  to
/about_files/LICENSE-2.0.txtin the project
/about_filesfolder in the project
/about_files/SAX-LICENSE.htmlfrom the old project to the
/about_filesfolder of the new project
- Copy the entire
/about_filesfolder (and all its contents) from the new project into the
/source-bundlefolder of the new project - giving us a
/source-bundle/about_filesfolder (and contents)
- Copy the
/etcfolder (and all its contents) from the new project to the
/source-bundlefolder - giving us a
/source-bundle/etcfolder (and contents)
- Copy the
about.htmlfile from the new project to the
- Copy the
/source-bundle/plugin.propertiesfiles from the old project into the
/source-bundlefolder of the new project (update the copyrights as needed)
- Copy the
/source-bundle/META-INFfolder (and all its contents) from the old project to the
/source-bundlefolder of the new project. Open the copied
/source-bundle/META-INF/MANIFEST.MFfile and update the bundle version number to match the new project version
- Copy the entire directory (and all its contents) from
/source-bundle/libsrcfolder of the new project - giving us a
/source-bundle/libsrc/orgrooted directory in the new project
Thats it! We now have the source bundle prepared.
At this point the Apache bundle is fully functional, so any projects that were closed earlier can be reopened. If there is some weirdness happening, like an error showing up on the Plug-in Dependencies container, simply restart Eclipse and do a full clean - like I mentioned having Apache Ant in your workspace can cause the PDE to behave strangely.
In the next section we will talk about testing the bundle and some expected changes to the Platform Ant code.
Updating Platform Ant
Depending on the scope of changes from the previous release, there could be nothing but test updates to make. In this section, I will only discuss running the test suites and the required updates to bundle versions and tests. I also am assuming you have the platform Ant source in your workspace.
Any changes you make to platform Ant should be attached to the bugzilla that was opened for updating to the new version of Apache Ant.
A complete test pass of the smoke-testing script must be completed. See the test script page for more details.
If the new version of Apache Ant changes API or requires significant changes that make it no longer compatible with the previous version, you will have to go through all of the platform Ant bundles and makes sure they have a minimum requirement on the new version. If, however, the changes are minimal (a point release) you should not have to make any changes to the platform Ant required versions.
Updating the tests
One of the first things you would have done with your new Apache Ant bundle is to run the test suites to make sure there are no regressions.
In doing so, you would find two tests that will always fail when a new version of Apache Ant is used:
The reason being that these two tests both test the version that is returned from launching Ant, so you have to update the constants in both classes to the latest version string.
Approval for use
Once you are happy with the new version and everything is working as expected, we have to open a CQ to get approval to add the new version to Orbit and to use it in the platform.
To get approval:
- Go to https://dev.eclipse.org/ipzilla/ and find the most recent approved update for Apache Ant. We want the CQ approved for use in eclipse.platform. As of this writing that is: Apache Ant 1.9.2
- Actually creating a new CQ will require a committer, so if you are not one, find one to do it for you and ask really nicely. Remind the committer (or yourself) to mention the previously approved version in the description of the new CQ (the reason we looked it up)
- Once the CQ is open you have to attach the source WITHOUT any embedded archives. So for our snazzy new bundle we created in the Creating the Orbit bundle section, we have to remove the
/libfolder completely before zipping it up and attaching to the CQ
- The CQ will go through a few stages, but just remember if it is set back to awaiting_committer you have to address the issues raised and DO NOT forget to return it to the IP team (use the button).
Eventually the CQ will be approved and the
checkintocvs keyword will be added. Leading to the next section, actually getting it into Orbit.
Put it in Orbit
With the use of the new version approved in the last section, we need to commit the new bundle to Orbit. Like creating the CQ, this step requires commit rights, specifically to Orbit. If you do not have commit rights to Orbit you can find a committer to help on the Obit committers page. Ideally you would ask the committer listed as being responsible for the particular project, failing that asking another one won't hurt. As of this writing the the committer responsible for org.apache.ant is Michael Rennie.
Once the bundle has been added to Orbit, you can delete it from your workspace and grab the version committed to Orbit!
Testing and Test builds
Now that we have the latest and greatest new version in Orbit, we need a test build with the latest version to make sure it works with the rest of the platform (smoke testing).
Before bugging David Williams for run a test build for the platform, go through the relevant steps on the Orbit builds wiki to produce a testable build yourself. Once you are confident, you can request David run a build of the platform with the new version of Apache Ant.
With a freshly minted platform build in your hands, at a minimum confirm:
- The names of the new Apache Ant bundles (core and source) show up correctly in the About dialog
- Debug something to ensure the Apache Ant source can be found
- Open a type from Apache Ant to make sure the source can be found
- Close Apache Ant in your workspace and re-run the unit tests to make sure they all still pass.
- A complete test pass of the smoke-testing script must be completed. See the test script page for more details.