View source for Authoring XML Schemas for use with EMF

{| align="right"
 | __TOC__
 |}

This article focuses on authoring and using XML Schemas for the purpose of generating an EMF model.

= Introduction =

{{IndentedSection|body=
An '''EMF Model''' (files of type *.genmodel) is your hub for importing/exporting other metamodel formats, linking to other EMF models, and generating implementation code. Out of the box, EMF can import '''XML Schema Definitions (XSDs)''' into '''Ecore Models''' (files of type *.ecore). Similarly, EMF can export Ecore Models to XSDs. But without an understanding of the differences between these two metamodels, and without knowing how to control the mapping process, the results will often be less than desired.

Luckily, both Ecore models and XML Schemas have support for annotations. Annotations can be almost anything, but for this discussion, annotations serve two purposes:

* Provide additional information when transforming one metamodel to another
* Provide additional information on how to serialize/deserialize your model objects

EMF supports transformations in either direction (to or from XSDs). Currently, if you start with an Ecore model, round-tripping to XSD and back to Ecore should be lossless. However, Ecore supports some structures that have no XSD equivalent, such as multiple inheritance. Information will be lost in such cases. Also, if you start with an XSD, not all of the information is captured in the Ecore model. Therefore, "round-tripping" XSD->Ecore->XSD is not a recommended practice as of the Europa release. Information might get lost, and almost certainly will get shuffled around.

This article will focus only on the practice of authoring (and annotating) XSDs and importing them into Ecore models. However, it can be a useful learning tool to model certain structures first in Ecore, and then exporting to see the annotated XSD equivalent.
}}

==Reasons to use XSDs with EMF==

{{IndentedSection|body=Here are a few reasons why XSDs are used with EMF:
* The XSD already exists
* You must ship an XSD
* Using an XSD is one way to customize how EMF models are persisted
}}

==Important Differences between XSDs and Ecore Models==

===Multiple Inheritance===

{{IndentedSection|body=
<table class="gallery" style="margin:1em">
<tr style="text-align:center">
<td width="50%">'''Ecore Models'''</td>
<td width="50%">'''XML Schemas'''</td>
</tr>
<tr>
<td><P>EMF's EClass supports multiple inheritance, which allows you to mix-in structural features like attributes at multiple places in your generated class hiearchy. However, the java language does not support multiple ''class'' inheritance, so the actual implementation behind the shared java interface is generated multiple times.</P>
<P>One benefit to using multiple inheritance with EMF is that the metamodel is shared. Clients that use the reflective API or receive model events will see the same shared feature even though the implementation has been duplicated.</P></td>
<td><P>XML Schemas do '''not''' support multiple inheritance. A Complex Type can only extend one other Complex Type.</P>
<P>As an approximation, XSDs allow attribute groups do be define. They can be reused multiple times. However, each time an attribute group is reused, it is treated as a copy of those attributes, rather than a shared reference.</P></td>
</tr>
</table>}}

===Global Elements and Attributes===

{{IndentedSection|body=
<table class="gallery" style="margin:1em">
<tr style="text-align:center">
<td width="50%">'''Ecore Models'''</td>
<td width="50%">'''XML Schemas'''</td>
</tr>
<tr>
<td>Ecore's Attributes and References always occur in the context of a containing EClass. They can not be declared on their own, and later pulled in to one or more EClasses.</td>
<td>XSDs allow global elements and attributes to be defined and then referenced multiple times. This type of "referencing" actually results in a copy.</td>
</tr>
</table>
}}

==The Transformation Process==

{{IndentedSection|body=The overall process looks like:
# An EMF Model is created and associated with one or more XSDs
# When the Wizard finishes, the conversion process creates *.ecore files
# At this point, EMF will not read your XSDs again. All information needed by EMF has been tucked away somewhere else.
# If you modify your schemas, the transformation can be performed again from the .genmodel Editor. Affected Ecore models are completely replaced.}}

===Which Parts of an XML Schema are Processed?===

{{IndentedSection|body=
Without being told otherwise, EMF will process your Schema, all of its globally declared Elements, and all Types contained therein. Other content (e.g. globally-declared Attributes, AttributeGroups, and Groups) is ignored by EMF. These entries are just macros that Elements and Types can reference, effectively in-lining a copy. If two Types reference the same global Attribute, AttributeGroup, or Element, EMF sees them as two distinct features which happen to have identical information.
}}

===What is the Output of the Process?===

{{IndentedSection|body=
The Process generates, updates, or replaces the following:

#; Ecore Models
#: Schemas become Packages; Simple/Complex Types become EClasses, EDataTypes, and EEnums; Elements and Attributes become EStructuralFeatures
#; Annotations in your Ecore Models
#: Ecore annotations are added in several places to capture the way your model should be serialized/deserialized. These annotations are what enable EMF to read and write XML documents that don't conform to EMF's default serialization format.
#; A Helper EClass named "DocumentRoot"
#: In certain cases, EMF must create a DocumentRoot class to store additional information.
#; Helper EStructuralFeatures, such as feature maps with the suffix "group"
#: To handle XSD features like substitution groups, the substitution rule to be used when writing must be known. To handle these cases, your Class' EReferences don't hold onto the actual content, but are instead derived from these "group" references which contains keys in addition to the actual referenced object.
#; Your EMF Model
#: References to the schemas you imported are kept so that you can invoke a reload later. Generations options are configured the first time with different defaults, under the assumption that you'll be reading and writing to XML files.
}}

=Mapping XSD to Ecore=

More information on this subject can be also found in draft document XML Schema to Ecore Mapping. [http://www.eclipse.org/modeling/emf/docs/overviews/XMLSchemaToEcoreMapping.pdf]

==Mapping Schema to EPackage==

Each XML Schema is mapped to an EPackage.

(in progress...)

==Mapping Types==

{{IndentedSection|body=Types in a Schema are mapped to ''Classifiers'' in Ecore (one of EClass, EDataType, EEnum). A Complex Type always results in a Class, but a Simple Type can be mapped to either a DataType or an Enum, depending on the presence of restricted values.}}

===Mapping SimpleType to EDataType/EEnum===

An EDataType will be created if there are no enumerations:

{{AnnotatedSourceCode}}

{{AnnotatedLine}}
{{CodeCell|1}}<xs:simpleType
| EDataType

{{AnnotationSection|name=Default Mappings}}

{{AnnotatedLine}}
{{CodeCell|3}}name="RGB"
{{AnnotationCell| -> Name (unless overridden)}}

{{AnnotationSection|name=Override Default Mapping}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:ignore="true"
{{AnnotationCell|Ignores this type}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:name="overrideName"
{{AnnotationCell|Determines the name}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:instanceClass="package.JavaType"
{{AnnotationCell|Determines the fully qualified java Class or Interface}}

|-
{{CodeCell|3}}... >

{{AnnotatedLine}}
{{CodeCell|2}}<xs:restriction base="xs:string"/>
{{AnnotationCell|Determines the Instance Class Name in many cases}}

|-
{{CodeCell|1}}</xs:simpleType>

|}

If the restriction includes enumerations an EEnum is created:

{{AnnotatedSourceCode}}

{{AnnotatedLine}}
{{CodeCell|1}}<xs:simpleType
| EEnum

{{AnnotatedLine}}
{{CodeCell|3}}name="Align"
{{AnnotationCell| -> Name (unless overridden)}}

{{AnnotationSection|name=Overriding Default Mappings}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:ignore="(true)"
{{AnnotationCell|Ignores this Simple Type}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:name="<u>$name</u>|override"
{{AnnotationCell|Overrides the Name, normally determined by name}}

|-
{{CodeCell|3}}...<BR>>

|-
{{CodeCell|2}}<xs:restriction>

{{AnnotatedLine}}
{{CodeCell|3}}<xs:enumeration
| EEnum Literal (for each xs:enumeration)

{{AnnotatedLine}}
{{CodeCell|5}}value="Left"

{{AnnotatedLine}}
{{CodeCell|5}}ecore:value="<u>auto</u>|int"
{{AnnotationCell|Overrides the Literal's Value}}

{{AnnotatedLine}}
{{CodeCell|5}}ecore:name="<u>auto</u>|override"
{{AnnotationCell|Overrides the Literal's Name, normally determined by value}}

|-
{{CodeCell|5}}...<BR>/>
|-
{{CodeCell|3}}<xs:enumeration value="Center"/>
|-
{{CodeCell|3}}<xs:enumeration value="Right"/>
|-
{{CodeCell|2}}</xs:restriction>
|-
{{CodeCell|1}}</xs:simpleType><BR>...

|}

===Complex Type to EClass===

{{AnnotatedSourceCode}}

{{AnnotatedLine}}
{{CodeCell|1}}<xsd:complexType
|EClass

{{AnnotatedLine}}
{{CodeCell|3}}name="Container"
{{AnnotationCell| -> Name (unless overridden)}}

{{AnnotatedLine}}
{{CodeCell|3}}abstract="<u>false</u>|true"
{{AnnotationCell| -> Abstract (qualifier on the impl class)}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:name="<u>$name$</u>|override"
{{AnnotationCell|Overrides name}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:implements="(tns:MixinInterface)"
{{AnnotationCell|Adds additional supertypes to the EClass. See the section on multiple inheritance.}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:interface="<u>false</u>|true">
{{AnnotationCell|If <tt>true</tt> only the java interface is generated}}

{{AnnotatedLine}}
{{CodeCell|2}}<xsd:complexContent>

{{AnnotatedLine}}
{{CodeCell|3}}<xsd:extension base="tns:Child">
{{AnnotationCell|Determines the first Super Type of the EClass}}

{{AnnotatedLine}}
{{CodeCell|4}}...<BR>(Structural Features)<BR>...
{{AnnotationCell|Elements and Attributes which appear here are described elsewhere}}

{{AnnotatedLine}}
{{CodeCell|3}}</xsd:extension>

{{AnnotatedLine}}
{{CodeCell|2}}</xsd:complexContent>

{{AnnotatedLine}}
{{CodeCell|1}}</xsd:complexType>

|}

==Mapping Structural Features==

===Common Mapping Options===

[[Image:Xsd_emf_mapping_features.gif]]

Whether you're mapping an xsd:attribute or xsd:element to an EAttribute or EReference, most of the mapping options for EStructuralFeatures are shared.

{{AnnotatedSourceCode}}
|- style="text-align:left" |
! XML Schema
! Description

|- style="color:gray" |

{{CodeCell|0}}<xsd:complexType name="Book">

|- style="color:gray" |
{{CodeCell|1}}...

|-
{{CodeCell|2}} <xsd:''feature''
| ''EStructuralFeature'' (EReference or EAttribute)

{{AnnotationSection|name=Default Mappings}}

{{AnnotatedLine}}
{{CodeCell|3}}name="author"
{{AnnotationCell| -> name (The feature's name) }}

{{AnnotatedLine}}
{{CodeCell|3}}type=''type''
{{AnnotationCell| -> attributeType for EAttributes<BR>-> referenceType for EReferences }}

{{AnnotatedLine}}
{{CodeCell|3}}default="value"/>
{{AnnotationCell| -> (needs review) Default Value Literal}}

{{AnnotationSection|name=Overriding the default mappings}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:ignore="<u>false</u>|true"
{{AnnotationCell|Instructs EMF not to perform any mapping}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:name="<u>$auto$</u>|name"
{{AnnotationCell|Overrides the name}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:lowerBound = "<u>$auto$</u>|n"
{{AnnotationCell|Overrides the '''lower bound''', which is normally calculated from other information to be 0 or 1}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:upperBound = "<u>$auto$</u>|n"
{{AnnotationCell|Overrides '''upper bound''', normally calculated from other information to be 1 or "many" }}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:required="<u>$auto$</u>|boolean"
{{AnnotationCell| Default value is calculated by EMF, perhaps when lower bound &gt; 0 (review needed) }}

{{AnnotationSection|name=Ecore Specific}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:unsettable="''boolean''"
{{AnnotationCell|Overrides unsettable, default value is true if lower bound is 0, OR upper bound is 1 (review needed) }}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:suppressedGetVisibility="<u>false</u>|true"
{{AnnotationCell|Removes the accessor method from the generated interface only }}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:suppressedSetVisibility="<u>false</u>|true"
{{AnnotationCell|Removes the set method method from the generated interface only }}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:suppressedIsSetVisibility="<u>false</u>|true"
{{AnnotationCell|Removes the "is set" method method from the generated interface only }}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:suppressedUnsetVisibility="<u>false</u>|true"
{{AnnotationCell|Removes the unset method method from the generated interface only }}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:transient="<u>$auto$</u>|''boolean''"
{{AnnotationCell|False by default, unless a featuremap is involved. Transient features are '''not''' persisted }}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:derived="<u>$auto$</u>|''boolean''"
{{AnnotationCell|False by default, unless a featuremap is involved.}}

{{AnnotatedLine}}
{{CodeCell|3}}ecore:volatile="<u>false</u>|true"
{{AnnotationCell|False is assumed}}

|- style="color:gray" |
{{CodeCell|1}}</xsd:sequence>

|- style="color:gray" |
{{CodeCell|0}}</xsd:complexType>

|}

===Mapping to EAttributes===

{{IndentedSection|body=
[[Image:Xsd_emf_mapping_to_attribute.gif]]

<P>XSD Elements and Attributes whose types are SimpleTypes always map to EAttributes. The only exceptions are "HREF" types such as "xs:anyURI" or "xs:IDREF", which must be treated as EReferences.

}}

{{AnnotatedSourceCode}}
|+ In the XML, an EAttribute may takes several forms:
|-
{{CodeCell|1}}<Event <u>message="Something happened"</u>/>
|-
| (Or)
|-
{{CodeCell|1}}<Event>
|-
{{CodeCell|2}}<u><message>Something happened</message></u>
|-
{{CodeCell|1}}</Event>
|-
| (Or)
|-
{{CodeCell|1}}<Event>
|-
{{CodeCell|2}}<u><message>First Message</message></u>
|-
{{CodeCell|2}}<u><message>Second Message</message></u>
|-
{{CodeCell|1}}</Event>

|}

Note that elements must be used for attributes with multiplicity &gt;1.

{{AnnotatedSourceCode}}
|- style="text-align:left" |
! XML Schema
! Description

|- style="color:gray" |
{{CodeCell|0}}<xsd:complexType name="Event"><BR>...

{{AnnotatedLine}}
{{CodeCell|2}}<xsd:(attribute|element)
{{AnnotationCell|EAttribute}}

{{AnnotationSection|name=Default Mappings}}

|-
{{CodeCell|4}}name="message"
| -> name

|-
{{CodeCell|4}}type="xsd:string"
| -> attributeType (must be SimpleType -> EDataType)

|-
{{CodeCell|4}}default="Hello world"
| -> Default Value Literal

{{AnnotationSection|name=xsd:attributes only}}

{{AnnotatedLine}}
{{CodeCell|4}}use="<u>optional</u>|required|prohibited"
{{AnnotationCell| Affects upper and/or lower bounds }}

{{AnnotationSection|name=xsd:elements only}}

{{AnnotatedLine}}
{{CodeCell|4}}minOccurs="''value''"<BR>maxOccurs="''value''"
{{AnnotationCell| Affects upper and/or lower bounds }}

|-
{{CodeCell|4}}...<BR>/>

|- style="color:gray" |
{{CodeCell|1}}...

|- style="color:gray" |
{{CodeCell|0}}</xsd:complexType>

|}

===Mapping Element to Contained EReference===

Elements with {{HoverText|<nowiki>e.g. <xsd:element type="tns:Address"></nowiki>|Complex Types}} can only be mapped to EReferences. Since Elements represent nested data in a document, it's no surprise that the EReference must be contained. EReferences which are not contained are saved as URIs to some other location, which means that a Simple Type is sufficient.

In a document, contained content could appear as:

{{AnnotatedSourceCode}}
|-
{{CodeCell|0}}<List>
|-
{{CodeCell|1}}<Item text="This is item 1"/>
|-
{{CodeCell|1}}<Item text="This is item 2"/>
|-
{{CodeCell|0}}</List>
|}

{{AnnotatedSourceCode}}
|- style="text-align:left" |
! XML Schema
! Description

|- style="color:gray" |
{{CodeCell|0}}<xsd:complexType name="Container">
|- style="color:gray" |
{{CodeCell|1}}<xsd:sequence>
|- 
{{CodeCell|2}}<xsd:element
| EReference

|-
{{CodeCell|4}}name="child"

|-
{{CodeCell|4}}type="tns:Child"

| -> EClass (type must be Complex)

{{AnnotatedLine}}
{{CodeCell|4}}minOccurs="0|<u>1</u>|n"
{{AnnotationCell| -> Lower Bound}}

{{AnnotatedLine}}
{{CodeCell|4}}maxOccurs="0|<u>1</u>|n|unbounded"
{{AnnotationCell| -> Upper Bound}}

{{AnnotationSection|name=Overriding default mappings}}

|-
{{CodeCell|4}}ecore:lowerBound = "<u>$minOccurs$</u>|n"

|-
{{CodeCell|4}}ecore:upperBound = "<u>$maxOccurs$</u>|n"

{{AnnotationSection|name=Ecore Specific}}

{{AnnotatedLine}}
{{CodeCell|4}}ecore:opposite="<u>null</u>|opposite"
{{AnnotationCell|Identifies the inverse EReference using the XSD element/attribute name from the ComplexType }}

{{AnnotatedLine}}
{{CodeCell|4}}ecore:changeable="false|<u>true*</u>"
{{AnnotationCell| True by default<BR> * may be false when featureMaps are involved (review needed) }}

|-
{{CodeCell|4}}...<BR>/>
|- style="color:gray" |
{{CodeCell|1}}</xsd:sequence>
|- style="color:gray" |
{{CodeCell|0}}</xsd:complexType>

|}

===Mapping to uncontained EReference===

[[Image:Xsd_emf_mapping_to_reference.gif]]

Both Attributes and Elements can be mapped to uncontained EReferences. As with EAttribute, only XSD elements will allow for multiplicity &gt;1.

{{AnnotatedSourceCode}}
|+ In the XML, the EReference may takes several forms:
|-
{{CodeCell|1}}<Event <u>origin="_DHejd3ks8dh3je8shre"</u>/>
|-
| (Or)
|-
{{CodeCell|1}}<Event>
|-
{{CodeCell|2}}<u><origin>_DHejd3ks8dh3je8shre</origin></u>
|-
{{CodeCell|1}}</Event>
|-
| (Or)
|-
{{CodeCell|1}}<Event>
|-
{{CodeCell|2}}<u><message>_DHejd3ks8dh3je8shre</message></u>
|-
{{CodeCell|2}}<u><message>_ks8dh3je8sXGejd3hre</message></u>
|-
{{CodeCell|1}}</Event>

|}

Note that elements must be used for references with multiplicity &gt; 1.

{{AnnotatedSourceCode}}
|- style="text-align:left" |
! XML Schema
! Description

|- style="color:gray" |
{{CodeCell|0}}<xsd:complexType name="Event"><BR>...

{{AnnotatedLine}}
{{CodeCell|2}}<xsd:(attribute|element)
{{AnnotationCell|EAttribute}}

{{AnnotationSection|name=Default Mappings}}

|-
{{CodeCell|4}}name="source"
| -> name

{{AnnotatedLine}}
{{CodeCell|4}}type="xsd:anyURI"
{{AnnotationCell| resolveProxies and other settings are sensitive to the ref type (review needed)}}

{{AnnotatedLine}}
{{CodeCell|4}}*type="ecore:type"
{{AnnotationCell| (*required) EMF must be told the type of the reference (review needed)}}

|-
{{CodeCell|4}}default="???"
| Does a default value make any sense (review needed)

{{AnnotationSection|name=xsd:attributes only}}

{{AnnotatedLine}}
{{CodeCell|4}}use="<u>optional</u>|required|prohibited"
{{AnnotationCell| Affects upper and/or lower bounds }}

{{AnnotationSection|name=xsd:elements only}}

{{AnnotatedLine}}
{{CodeCell|4}}minOccurs="''value''"<BR>maxOccurs="''value''"
{{AnnotationCell| Affects upper and/or lower bounds }}

|-
{{CodeCell|4}}...<BR>/>

|- style="color:gray" |
{{CodeCell|1}}...

|- style="color:gray" |
{{CodeCell|0}}</xsd:complexType>

|}

= Tips and Techniques =

== Almost Multiple Inheritance ==

{{IndentedSection|body=
An XSD ComplexType may have at most one super-type, while both Ecore and the java language support multiple inheritance. Single inheritance is just too restrictive, so most Ecore models, or equivalently, most model APIs, are going to need more.

If the assumptions made by the architects of java are correct, then the only useful form of multiple inheritance is to "overlay" additional method signatures onto a class already extending some other class. (Or in the simplest case, just for "tagging", e.g. java.lang.Cloneable). Let's hope they're right, because these are basically the same limitations we are dealing with here.

It may be useful to think of the "single inheritance" permitted for ComplexTypes as being similar to java class extension. Java only allows you to inherit one implementation class. This "free", inherited implementation is analogous to the free, inherited attributes and elements from your base ComplexType. Let's say that we mix in an additional ComplexType using <tt>ecore:implements="tns:SecondSuper"</tt>. When you try to save an xsd:attribute or xsd:element inherited this way, you can't.  Your schema has no idea what you're talking about.

So, let's think of mix-in types as interfaces that can never be "implemented". Implementation here refers to being persisted using something actually defined in your XSD.

(in progress..)
}}