Skip to main content

Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

Difference between revisions of "Eclipse Oomph Authoring"

Line 19: Line 19:
 
## Start the installer and install an IDE of your choice (select on the first installer page), or
 
## Start the installer and install an IDE of your choice (select on the first installer page), or
 
## Use p2 to install "Oomph Setup SDK" from [http://download.eclipse.org/oomph/updates/latest http://download.eclipse.org/oomph/updates/latest].
 
## Use p2 to install "Oomph Setup SDK" from [http://download.eclipse.org/oomph/updates/latest http://download.eclipse.org/oomph/updates/latest].
# Create a new "Project Setup Model" file in your releng (or any other) project:<br>[[Image:new-wizard.png]] [[Image:new-wizard-2.png]] [[Image:new-wizard-3.png]]
+
# Create a new "Project Setup Model" file in any existing workspace project:<br>[[Image:new-wizard.png]] [[Image:new-wizard-2.png]] [[Image:new-wizard-3.png]]
 
# Open the resulting setup file with Oomph's Setup Editor:<br>[[Image:setup-edit.png]]
 
# Open the resulting setup file with Oomph's Setup Editor:<br>[[Image:setup-edit.png]]
 
# Add setup tasks to your project and/or to your project streams:<br>[[Image:setup-edit2.png]]
 
# Add setup tasks to your project and/or to your project streams:<br>[[Image:setup-edit2.png]]
 
# Configure the tasks in the Properties view. Note that there are "Expert" properties available:<br>[[Image:setup-edit3.png]]
 
# Configure the tasks in the Properties view. Note that there are "Expert" properties available:<br>[[Image:setup-edit3.png]]
 
# The Outline view displays a ''preview'' of the executable model with resolved variables:<br>[[Image:setup-edit4.png]]
 
# The Outline view displays a ''preview'' of the executable model with resolved variables:<br>[[Image:setup-edit4.png]]
# To test/execute your new setup model start the installer (see step 1), pick any product on page 1 and click <em>Next</em> to proceed to page 2. Then drag and drop your <tt>.setup</tt> file onto one of the top-level catalogs (<tt>Eclipse.org</tt> or <tt>Github.com</tt>) in the projects tree. Your project will appear as a subproject of the special <tt>&lt;User&gt;</tt> project. Now double-click your project to add it to the table at te bottom of the page. There you can select a project stream in the <em>Stream</em> column. Press the <em>Next</em> button and fill the empty fields on the <em>Variables</em> page. Confirm on the following page by clicking <em>Finish</em>. The installer will first bootstrap a new IDE and then launch it to complete the installation at startup time.
+
# To test/execute your new setup model:
 +
## Start the installer (see step 1) and, if necessary, switch to the Advanced Mode via the dialog menu.
 +
## Pick any product on page 1 and click the Next button to proceed to page 2.
 +
## Drag and drop your <tt>.setup</tt> file onto one of the top-level catalogs (<tt>Eclipse.org</tt> or <tt>Github.com</tt>) in the projects tree. Your project will appear as a subproject of the special <tt>&lt;User&gt;</tt> project.
 +
## Double-click your project to add it to the table at te bottom of the page. There you can select a project stream in the Stream column. Press the Next button to proceed to the Variables page.
 +
## Fill in the empty fields and press the Next button to proceed to the Confirmation page.
 +
## Click Finish to start the installation process. The installer will first bootstrap a new IDE and then launch it to complete the installation at startup time.
 
# Chances are that your first model contains errors. Always turn on live validation in the Setup editor to get early feedback. If the installation fails early and the new IDE doesn't come up go back to step 6. If the IDE comes up but the initial configuration fails continue with step 10.
 
# Chances are that your first model contains errors. Always turn on live validation in the Setup editor to get early feedback. If the installation fails early and the new IDE doesn't come up go back to step 6. If the IDE comes up but the initial configuration fails continue with step 10.
# In the new IDE (whether the initial configuration was successful or not) open the model file with the [[Image:branch.png]] button from the main toolbar. Find the problems and fix them. Then start the configuration process '''from within''' this IDE by pressing the [[Image:update.png]] button in the main toolbar. This "manual trigger" will pop up a confimation dialog before starting the configuration process so that you can review what tasks are scheduled for execution.
+
# In the new IDE (whether the initial configuration was successful or not) open your model file from the main menu, Navigate &rarr; Open Setup &rarr; [[Image:branch.png]]. Find the problems and fix them. Then start the setup process '''from within''' this IDE via the main menu, Help &rarr; [[Image:update.png]] Perform Setup Tasks&hellip;. This "manual trigger" will pop up a confirmation dialog before starting the setup process so that you can review what tasks are scheduled for execution.
 
+
'''Hint''': As an alternative to starting with an empty model you can also copy one of existing models:<br>[[Image:example-models.png]]
+
  
 
== Contributing to the Eclipse.org Project Catalog ==
 
== Contributing to the Eclipse.org Project Catalog ==

Revision as of 05:24, 20 June 2015

Warning2.png
Outdated content
A complete author's guide is currently under construction (help center documentation). The wikis are quite outdated, see this forum thread for more information. A link will be published here when it is ready.


What is Oomph?

Please read Eclipse Installer.


Getting Started

For now here are some easy steps for creating a new setup model for your project:

  1. Download and install the Eclipse Installer as outlined in Eclipse Installer.
  2. Make sure that the Oomph setup SDK is installed in your IDE. Either:
    1. That's already the case because your IDE is a Mars M5 or later Eclipse Package, or
    2. Start the installer and install an IDE of your choice (select on the first installer page), or
    3. Use p2 to install "Oomph Setup SDK" from http://download.eclipse.org/oomph/updates/latest.
  3. Create a new "Project Setup Model" file in any existing workspace project:
    New-wizard.png New-wizard-2.png New-wizard-3.png
  4. Open the resulting setup file with Oomph's Setup Editor:
    Setup-edit.png
  5. Add setup tasks to your project and/or to your project streams:
    Setup-edit2.png
  6. Configure the tasks in the Properties view. Note that there are "Expert" properties available:
    Setup-edit3.png
  7. The Outline view displays a preview of the executable model with resolved variables:
    Setup-edit4.png
  8. To test/execute your new setup model:
    1. Start the installer (see step 1) and, if necessary, switch to the Advanced Mode via the dialog menu.
    2. Pick any product on page 1 and click the Next button to proceed to page 2.
    3. Drag and drop your .setup file onto one of the top-level catalogs (Eclipse.org or Github.com) in the projects tree. Your project will appear as a subproject of the special <User> project.
    4. Double-click your project to add it to the table at te bottom of the page. There you can select a project stream in the Stream column. Press the Next button to proceed to the Variables page.
    5. Fill in the empty fields and press the Next button to proceed to the Confirmation page.
    6. Click Finish to start the installation process. The installer will first bootstrap a new IDE and then launch it to complete the installation at startup time.
  9. Chances are that your first model contains errors. Always turn on live validation in the Setup editor to get early feedback. If the installation fails early and the new IDE doesn't come up go back to step 6. If the IDE comes up but the initial configuration fails continue with step 10.
  10. In the new IDE (whether the initial configuration was successful or not) open your model file from the main menu, Navigate → Open Setup → Branch.png. Find the problems and fix them. Then start the setup process from within this IDE via the main menu, Help → Update.png Perform Setup Tasks…. This "manual trigger" will pop up a confirmation dialog before starting the setup process so that you can review what tasks are scheduled for execution.

Contributing to the Eclipse.org Project Catalog

When you are done authoring your model file (including testing the installation) commit/push it to the master branch of one of your Eclipse Git repositories. Find the plain URL of this file in http://git.eclipse.org/c and submit a bugzilla asking for the inclusion of your model into the main index. Paste the Git plain URL of your model into the bug description.

Understanding the Setup Engine

The setup engine collects the setup tasks that are needed for a particular installation from a number of places (called scopes):

  • The Configuration scope is the top level scope with a small number of tasks that apply to all installations. The tasks in this scope are controlled by the Oomph team.
  • An Eclipse scope contains a small number of tasks to install a minimum IDE of a specific Eclipse version. There are several predefined Eclipse scopes nested in the Configuration (see above). All of them are controlled by the Oomph team. The user selects one of them for a particular installation at install time. This can be simulated at authoring time with the view toolbar choices in the Outline (Preview) view of the model editor.
  • The Project scope contains tasks that apply to any installation that is linked to one of your branches (see below). You have full control over these tasks. Press the Branch.png button from the main toolbar to edit them.
  • The Branch scope contains tasks that apply to any installation that is linked to this branch. You have full control over these tasks. The user selects one of them for a particular installation at install time. Press the Branch.png button from the main toolbar to edit them.
  • The Preferences scope contains tasks that apply to any installation (unless they're explicitely restricted to specific higher scopes such as a specific branch or Eclipse version). The user has exclusive control over these tasks. They are stored in the user's home folder: ${user.home}/.eclipse/org.eclipse.emf.cdo.releng.setup/setup-eclipse.xmi. Press the User.png button from the main toolbar to edit them.

The resulting list of tasks is then flattened, that is, compound tasks (folders) are recursively replaced by their contained tasks. Disabled tasks (see the editors context menu) are removed from the list. Tasks that are restricted to scopes that are not chosen for the current installation are also removed. Tasks that are excluded from the current trigger (one of Bootstrap, Startup or Manual) are also removed.

The remaining list is then partially reordered according to a number of criteria such as task priority (hardcoded), variable references or explicit (modeled) task requirements. If no such criteria apply the tasks are kept in their modeled order as much as possible.

Some types of tasks allow only one instance in the list of tasks. For example only one variable task (see below) with a given variable name is allowed to execute. To specify several of them (with the same name) is perfectly okay, but you should notice that the earlier (according to the established order; see above) tasks are replaced/overridden by the later ones. This way, for example, a user can always override such tasks from any high/early scope, e.g., the project or branch scope, in his local Preferences scope.

Now variable references in all String attributes of the tasks and their child elements are resolved and replaced by their expanded values. For details see Using Variables below.

Then the engine calls the isNeeded() method on each task in the list and removes those that are not needed (possibly according to the state of the running IDE).

If now the list of needed tasks is not empty a confirmation dialog is displayed and when the user presses Install the perform() method is called on that tasks. The progress of the installation process is then displayed in a progress dialog. The installation can be canceled at any point in time.

Using Variables

Variables play a very important role in the execution process. While a project model can perfectly work without the declaration or use of variables the model is typically more flexible with them. A variable must always be declared with a Variable Task somewhere in the model. It must have a name and can have a value. If it has no value a prompt dialog is displayed early in the execution process. The user can enter the missing variable values, which are then stored as variable tasks in the Preferences scope (see above). These stored variable tasks are restricted to the scope that originally declared the variable. At execution time these Preferences-scoped variable tasks override the respective variable tasks that you have declared in your project model. Important: Prompted values of variables that are declared with the type PASSWORD are not stored in ${user.home/.eclipse/org.eclipse.emf.cdo.releng.setup/setup-eclipse.xmi} but rather in an Equinox Secure Storage node. The setup framework ensures that they are never shown in the user interface.

You can use variables (refer to them) in any String-typed attribute of your model. The general syntax is:

  ${variable-name}

You can also extend variable references that evaluate to file system paths by adding a forward slash notation of the nested path before the closing brace. The advantage is that the full resulting path is formatted in the OS-specific form, e.g.:

  ${setup.branch.dir/git/my.project} evaluates to C:\develop\my.project\master\git\my.project on Windows

After the path extension part you can add filter calls with pipe symbols. Multiple filters can be chained. The filters "uri", "upper", "lower", "cap", "allcap" are currently available. Example:

  ${setup.branch.dir|uri}/git/my.project evaluates to file:/C:/develop/my.project/master/git/my.project

The following variables are predefined by the setup engine:

  • All system properties as returned by System.getProperties()
  • All environment variables as returned by System.getenv()
  • setup.state.dir --> ${user.home/.eclipse/org.eclipse.emf.cdo.releng.setup}
  • setup.p2.agent.dir --> ${user.home/.p2}
  • setup.p2.pool.dir --> ${setup.p2.agent.dir/pool}
  • setup.install.dir --> the root install folder as entered by the user
  • setup.project.dir --> ${setup.install.dir/project-name}
  • setup.branch.dir --> ${setup.project.dir/branch-name}
  • setup.eclipse.dir --> ${setup.branch.dir/eclipse}
  • setup.project.name --> project-name
  • setup.project.label --> project-label
  • setup.branch.name --> branch-name
  • setup.branch.label --> project-label + " " + branch-name

When looking for declared variables that you can use in your model also have a look at the Outline view that displays variables from the outer scopes. For example the current main configuration file for Eclipse.org projects contains declarations for some useful variables:

  • jre.1.4.location --> The folder containing a 1.4 compatible JDK/JRE for architecture ${os.arch}
  • jre.1.5.location --> The folder containing a 1.5 compatible JDK/JRE for architecture ${os.arch}
  • jre.1.6.location --> The folder containing a 1.6 compatible JDK/JRE for architecture ${os.arch}
  • jre.1.7.location --> The folder containing a 1.7 compatible JDK/JRE for architecture ${os.arch}
  • jre.1.8.location --> The folder containing a 1.8 compatible JDK/JRE for architecture ${os.arch}
  • git.user.id --> The Eclipse user ID for Git/Gerrit commits
  • git.author.name --> The Eclipse author name for Git/Gerrit commits
  • git.author.email --> The Eclipse author email for Git/Gerrit commits
  • eclipse.user.id --> The Eclipse user ID for Bugzilla/Hudson
  • eclipse.user.password --> The Eclipse password for Bugzilla/Hudson

The advantage of having these variables be declared in a project-independent scope is that their prompted values will be stored in the Preferences scope without a project restriction. Hence users will not be required to enter these values more than once even when they install additional environments. Of course they can be edited in the Preferences model at any time.

The recommended form of variable names is the dot-separated notation. Note that it is typically not possible to define environment variables with dots in their name. If you want to define variables in your process/system environment use underscores instead of the dots; you can still refer to them via dot-notation in your models.

Frequently Asked Questions

Why didn't the model editor tell me earlier that I've made a silly mistake?

Please enable Live Validation in the editor menu to get early feedback.


Tips and Tricks

Hosting your own index / product catalog

If you want to host your own product catalog, you must provide a URI mapping to the installer to locate the root setup file. Open the oomph.ini file and add an oomph.redirection.<some_id> where some_id is any unique identifier. The root EMF model is an Index and must be stored in the file org.eclipse.setup. Use http://git.eclipse.org/c/oomph/org.eclipse.oomph.git/plain/setups/org.eclipse.setup as a starting point. All of your other setup models can be stored in any file name you desire. You must also copy all of the model files in http://git.eclipse.org/c/oomph/org.eclipse.oomph.git/plain/setups/models/ to your redirection <path>/models/

  • -Doomph.redirection.setups=http://git.eclipse.org/c/oomph/org.eclipse.oomph.git/plain/setups/->http://<hostname>/<path>/


Generating PDE Target Definition files (*.target) and their use by Tycho

Oomph can automagically generate a *.target files compatible with the PDE target definition file format (*.target) for you from your *.setup model. This is particularly useful if used in combination with Tycho's support for them, see https://wiki.eclipse.org/Tycho/Target_Platform, as it allows you to maintain p2 Repositories and Requirements in one single place, and have that be used both for workspace set-up and builds.

To generate a *.target file, add an Annotation similar to the example found in Oomph's own setup model (see here http://git.eclipse.org/c/oomph/org.eclipse.oomph.git/tree/setups/Oomph.setup), like so:

     <annotation
         source="http:/www.eclipse.org/oomph/targlets/TargetDefinitionGenerator">
       <detail
           key="location">
         <value>${git.clone.location}/targetdefinition/DesignStudio.target</value>
       </detail>
       <detail
           key="extraUnits">
         <value>org.eclipse.equinox.executable.feature.group</value>
       </detail>
       <detail
           key="includeAllPlatforms">
         <value>false</value>
       </detail>
       <detail
           key="includeSource">
         <value>true</value>
       </detail>
       <detail
           key="generateVersions">
         <value>true</value>
       </detail>
     </annotation>

Note that the *.target file will be updated (or initially generated if first time) each time that Oomph Performs Setup Tasks (and not every time you only "touch" your *.setup model). Any errors encountered while generating the *.target file are reported in the Setup Log as usual.

TODO Document what preferredRepositories, PomModulesUpdater & PomArtifactUpdater do...

Copyright © Eclipse Foundation, Inc. All Rights Reserved.