Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
EclipseLink/DesignDocs/328404 new
Contents
- 1 Design Specification: Persistence Unit Composition
- 1.1 Document History
- 1.2 Project overview
- 1.3 Concepts
- 1.4 Requirements
- 1.5 Design Constraints
- 1.6 Design / Functionality
- 1.7 Testing
- 1.8 API
- 1.9 Tooling
- 1.10 Config files
- 1.11 Persistence Unit Properties
- 1.12 Entity Manager Properties
- 1.13 Limitations
- 1.14 Extensions
- 1.15 Documentation
- 1.16 Open Issues
- 1.17 Decisions
- 1.18 Known problems in 2.3
Design Specification: Persistence Unit Composition
This feature adds support for persistence units being composed. This means a user can define multiple persistence units with a unique set of entity types and expose them through a composite persistence unit which combines the set of classes across multiple data sources to expose a single persistence context.
Document History
Date | committer | description |
2011/04/06 | Andrei Ilitchev | Initial New Version |
Project overview
The goal is to combine several persistence units into a single one.
em.persist(new A(..)); em.persist(new Z(..)); // insert A into db1; insert Z into db2: // the two different data bases possibly from different vendors em.flush();
Concepts
Terminology
- Data Source: For the purposes of this discussion a data-source will include JTA and non-JTA data sources as well as EclipseLink's native JDBC connection pools.
- Composite PU: Refers to a PU which combines 2 or more Composite Member PUs to provide a persistence context which allows queries and transactions (with limitations) across the combined set of entity types.
Requirements
# | Description |
1 | Add support for a single persistence context accessing entities stored in different Data Sources (schemas/table-space/database) where application developers can perform queries and transactions across the complete set of entities transparently. |
2 | Support mapping relationships between entities in different Data Sources. |
3 | Provide easy to use JPA configuration. |
4 | Clearly capture usage limitations and exceptions expected in Java Docs and user documentation. The most basic example of this is the ability to join across tables in different Data Sources. This limitation effects mapping and query execution and optimizations. These issues need to be identified and documented. |
5 | Support container managed and application bootstrap JPA usage with dynamic, static, and no weaving. |
User Bugs
The following potentially related bugs should be taken into consideration in this feature work.
- JPA enhancement requests.
- bug 260258 - Add JPA EntityManagerFactoryBroker support
- Core bugs
- bug 269213 - SessionBroker handling of ExceptionHandler broken because stale copy/paste
- bug 281569 - Integration of JPA using transaction-type="JTA" but without EJB container, set-up incomplete commit cleanup
- bug 326649 - DatabaseSessionImpl.finalize() leads to ClassCastException
- bug 329185 - SessionBroker: ClassCastException in Cursor.buildAndRegisterObject between ServerSession and UnitOfWorkImpl
- bug 332581 - SessionBroker session event issues to consider and resolve when implementing JPA Session Broker
- bug 331712 - Allow Isolated classes to work with client session broker
Design Constraints
Design / Functionality
Testing
- The tests are (as always) in trunk\jpa\eclipselink.jpa.test, they are added to FullRegressionTestSuite.
- New test models were defined that mirror some existing test models.
- Each of the new models was divided into three composite members.
- Division was done in such a way that there are lots of references between classes that belong to different composite members.
- For each new model a new test suite was created that mirrors existing test suite.
- It might be useful to compare the sources of the original and composite versions of mapped classes and tests to see composite specifics and limitations.
- By default all three composite member persistence unit in each model will use the same data base (specified by db.* properties in test.properties file or passed to TestBrowser)
- To test with three different databases, in test.properties file specify
- either single.db=false - that would cause member_2 and member_3 to use connection parameters specified in their persistence.xml files;
- or db2.* and db3.* properties (following the pattern of db.* properties).
- member_1 always uses the main data base (specified by db.* properties in test.properties file or passed to TestBrowser).
- To test with three different databases, in test.properties file specify
Annotations
- Original
- Source (src)
- org.eclipse.persistence.testing.models.jpa.advanced.*
- org.eclipse.persistence.testing.tests.jpa.advanced.EntityManagerJUnitTestSuite
- Persistence Unit "default"
- Resource
- eclipselink-annotation-model
- Model jar file
- eclipselink-annotation-model.jar
- Resource
- Source (src)
- Composite
- Source (src)
- org.eclipse.persistence.testing.models.jpa.composite.advanced.*
- org.eclipse.persistence.testing.models.jpa.composite.advanced.member_1.*
- org.eclipse.persistence.testing.models.jpa.composite.advanced.member_2.*
- org.eclipse.persistence.testing.models.jpa.composite.advanced.member_3.*
- org.eclipse.persistence.testing.tests.jpa.composite.advanced.EntityManagerJUnitTestSuite
- Persistence Unit "composite-advanced"
- Resource
- eclipselink-composite-advanced-model
- eclipselink-composite-advanced-model-member_1
- eclipselink-composite-advanced-model-member_2
- eclipselink-composite-advanced-model-member_3
- Model jar file
- eclipselink-composite-advanced-model.jar
- Member jar files
- eclipselink-composite-advanced-model-member_1.jar
- eclipselink-composite-advanced-model-member_2.jar
- eclipselink-composite-advanced-model-member_3.jar
- Resource
- Members' database objects' (tables and sequences) names
- prefixed with "MBR1_", "MBR2_", "MBR3_" respectively.
- Source (src)
XML
- Original
- Source (src)
- org.eclipse.persistence.testing.models.jpa.xml.advanced
- org.eclipse.persistence.testing.tests.jpa.xml.advanced.EntityMappingsAdvancedJUnitTestCase
- to run it with pu "extended-advanced" (uses eclipselink-orm.xml) use -Dorm.testing=eclipselink
- Persistence Unit "default"
- Resource
- eclipselink-xml-only-model
- Model jar file
- eclipselink-annotation-model.jar
- Resource
- Persistence Unit "extended-advanced" (uses eclipselink-orm.xml)
- Resource
- eclipselinkorm\eclipselink-xml-extended-model
- Model jar file
- eclipselink-xml-extended-model.jar
- Resource
- Source (src)
- Composite
- Source (src)
- org.eclipse.persistence.testing.models.jpa.xml.composite.advanced.*
- org.eclipse.persistence.testing.models.jpa.xml.composite.advanced.member_1.*
- org.eclipse.persistence.testing.models.jpa.xml.composite.advanced.member_2.*
- org.eclipse.persistence.testing.models.jpa.xml.composite.advanced.member_3.*
- org.eclipse.persistence.testing.tests.jpa.composite.xml.composite.advanced.EntityMappingsAdvancedJUnitTestCase
- to run it with pu "xml-extended-composite-advanced" (uses eclipselink-orm.xml) use -Dorm.testing=eclipselink
- Persistence Unit "xml-composite-advanced"
- Resource
- eclipselink-xml-composite-advanced-model
- eclipselink-xml-composite-advanced-model-member_1
- eclipselink-xml-composite-advanced-model-member_2
- eclipselink-xml-composite-advanced-model-member_3
- Model jar file
- eclipselink-xml-composite-advanced-model.jar
- Member jar files
- eclipselink-xml-composite-advanced-model-member_1.jar
- eclipselink-xml-composite-advanced-model-member_2.jar
- eclipselink-xml-composite-advanced-model-member_3.jar
- Resource
- Persistence Unit "xml-extended-composite-advanced"
- Resource
- eclipselinkorm\eclipselink-xml-extended-composite-advanced-model
- eclipselinkorm\eclipselink-xml-extended-composite-advanced-model-member_1
- eclipselinkorm\eclipselink-xml-extended-composite-advanced-model-member_2
- eclipselinkorm\eclipselink-xml-extended-composite-advanced-model-member_3
- Model jar file
- eclipselink-xml-extended-composite-advanced-model.jar
- Member jar files
- eclipselink-xml-extended-composite-advanced-model-member_1.jar
- eclipselink-xml-extended-composite-advanced-model-member_2.jar
- eclipselink-xml-extended-composite-advanced-model-member_3.jar
- Resource
- Members' database objects' (tables and sequences) names
- prefixed with "XML_MBR1_", "XML_MBR2_", "XML_MBR3_" respectively.
- Source (src)
API
Tooling
The Dali team should be made aware of this feature work and track an enhancement request to uptake it.
Config files
- Composite PU must be configured in persistence.xml using property:
/** * Indicates if it's a composite persistence unit ("true"). * The property must be specified in persistence.xml of a composite persistence unit. * The property passed to createEntityManagerFactory method or in system properties is ignored. * Composite persistence unit would contain all persistence units found in jar files specified by <jar-file> elements in persistence.xml. * <jar-file>member1.jar</jar-file> * <jar-file>member2.jar</jar-file> * <properties> * <property name="eclipselink.composite-unit" value="true"/> * </properties> * @see #COMPOSITE_UNIT_MEMBER * @see #COMPOSITE_UNIT_PROPERTIES */ public static final String COMPOSITE_UNIT = "eclipselink.composite-unit";
- Composite Member PU may specify in persistence.xml that it can't be used as an independent persistence unit:
/** * Indicates if the persistence unit must be a member of a composite persistence unit ("true"), * can't be used as an independent persistence unit. * That happens if persistence unit has dependencies on other persistence unit(s). * The property may be specified in persistence.xml. * The property passed to createEntityManagerFactory method or in system properties is ignored. * If this property is set to true, EntityManagerFactory still could be created, * but it can't be connected: an attempt to create entity manager would cause an exception. * @see #COMPOSITE_UNIT * @see #COMPOSITE_UNIT_PROPERTIES */ public static final String COMPOSITE_UNIT_MEMBER = "eclipselink.composite-unit.member";
- While creating Composite PU EntityManagerFactory properties could be passed to Composite Member PUs:
/** * The property may be passed to createEntityManagerFactory method of a composite persistence unit * to pass properties to member persistence units. * The value is a map: * the key is a member persistence unit's name, * the value is a map of properties to be passed to this persistence unit. * "eclipselink.composite-unit.properties" -> ( * ("memberPu1" -> ( "javax.persistence.jdbc.user" -> "user1", * "javax.persistence.jdbc.password" -> "password1", * "javax.persistence.jdbc.driver" -> "oracle.jdbc.OracleDriver", * "javax.persistence.jdbc.url" -> "jdbc:oracle:thin:@oracle_db_url:1521:db", * ) , * ("memberPu2" -> ( "javax.persistence.jdbc.user" -> "user2", * "javax.persistence.jdbc.password" -> "password2" * "javax.persistence.jdbc.driver" -> "com.mysql.jdbc.Driver", * "javax.persistence.jdbc.url" -> "jdbc:mysql://my_sql_db_url:3306/user2", * ) * ) * @see #COMPOSITE_UNIT */ public static final String COMPOSITE_UNIT_PROPERTIES = "eclipselink.composite-unit.properties";
- Transaction type should be specified in composite persistence unit (transaction types of composite members ignored).
- Data sources should be specified in composite member persistence units (those specified in the composite are ignored).
Example
- compositePu specifies transaction type and server platform. It will contain all persistence units defined in member1.jar and member2.jar files.
<persistence xmlns="http://java.sun.com/xml/ns/persistence" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://java.sun.com/xml/ns/persistence persistence_1_0.xsd" version="1.0"> <persistence-unit name="compositePu" transaction-type="JTA"> <provider> org.eclipse.persistence.jpa.PersistenceProvider </provider> <jar-file>member1.jar</jar-file> <jar-file>member2.jar</jar-file> <properties> <property name="eclipselink.composite-unit" value="true"/> <property name="eclipselink.target-server" value="WebLogic_10"/> </properties> </persistence-unit> </persistence>
- memberPu1 defined in member1.jar file. It could be used independently as well as inside composite persistence unit.
<persistence xmlns="http://java.sun.com/xml/ns/persistence" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://java.sun.com/xml/ns/persistence persistence_1_0.xsd" version="1.0"> <persistence-unit name="memberPu1" transaction-type="JTA"> <provider> org.eclipse.persistence.jpa.PersistenceProvider </provider> <mapping-file>META-INF/advanced-entity-mappings1.xml</mapping-file> <jta-data-source>jdbc/OracleJtaDS</jta-data-source> <exclude-unlisted-classes>false</exclude-unlisted-classes> <properties> <property name="eclipselink.target-server" value="WebLogic_10"/> <property name="eclipselink.target-database" value="org.eclipse.persistence.platform.database.oracle.Oracle11Platform"/> </properties> </persistence-unit> </persistence>
- memberPu2 defined in member2.jar file. It has dependency on a class defined in member1.jar and can't be used independently.
<persistence xmlns="http://java.sun.com/xml/ns/persistence" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://java.sun.com/xml/ns/persistence persistence_1_0.xsd" version="1.0"> <persistence-unit name="memberPu2"> <provider> org.eclipse.persistence.jpa.PersistenceProvider </provider> <mapping-file>META-INF/advanced-entity-mappings2.xml</mapping-file> <jta-data-source>jdbc/MySqlJtaDS</jta-data-source> <exclude-unlisted-classes>false</exclude-unlisted-classes> <properties> <property name="eclipselink.composite-unit.member" value="true"/> <property name="eclipselink.target-database" value="org.eclipse.persistence.platform.database.MySQLPlatform"/> </properties> </persistence-unit> </persistence>
All three jars - composite and the two members - should be deployed on the same class loader. In case of application server the jars should by packed in an ear file; in standalone case put on the class pass. As usual compositePu could be accessed either through injection (in app. server case):
@PersistenceUnit(unitName="compositePu") EntityManagerFactory entityManagerFactory; @PersistenceUnit(unitName="compositePu") EntityManager entityManager;
or using Persistence:
EntityManagerFactory entityManagerFactory = Persistence.createEntityManagerFactory("compositePu", properties);
Persistence Unit Properties
- Composite Persistence Unit property could be specified either in its persistence.xml or passed to createEntityManagerFactory method;
- Composite member Persistence Unit property could be either specified in its persistence.xml or passed to composite's createEntityManagerFactory through "eclipselink.composite.properties" property.
PersistenceUnitProperties. | property name | composite pu | composite member pu | comment |
COMPOSITE_UNIT | eclipselink.composite-unit | processed | advanced | if specified by member then the member is substituted for its own members |
COMPOSITE_UNIT_MEMBER | eclipselink.composite-unit.member | advanced | processed | if specified by composite then the composite must be member of another composite |
COMPOSITE_PROPERTIES | eclipselink.composite.properties | processed | ignored | |
TRANSACTION_TYPE | javax.persistence.transactionType | processed | ignored | |
TARGET_SERVER | eclipselink.target-server | processed | ignored | |
LOGGING_* | eclipselink.logging.* | processed | ignored | |
PROFILER | eclipselink.profiler | processed | ignored | |
COORDINATION_* | eclipselink.cache.coordination.* | processed | ignored | |
SESSION_NAME | eclipselink.session-name | processed | advanced | member session name is used to read the session from sessions.xml, but the deployed session always has the same name as the member persistence unit (as it's defined in memberPuInfo.getPersistenceUnitName()) |
DEPLOY_ON_STARTUP | eclipselink.deploy-on-startup | processed | ignored | |
VALIDATION_ONLY_PROPERTY | eclipselink.validation-only | processed | processed | bug 348815: WRONG BEHAVIOUR in 2.3, should be processed by composite only, ignored by member persistence unit. Workaround for now: specify the property in the composite and in all its members. THAT HAS BEEN FIXED in 2.3.1. |
VALIDATION_* | eclipselink.validation.* | processed | ignored | |
CLASSLOADER | eclipselink.classloader | processed | ignored | |
THROW_EXCEPTIONS | eclipselink.orm.throw.exceptions | processed | ignored | |
FLUSH_CLEAR_CACHE | eclipselink.flush-clear.cache | processed | ignored | |
VALIDATE_EXISTENCE | eclipselink.validate-existence | processed | ignored | |
JOIN_EXISTING_TRANSACTION | eclipselink.transaction.join-existing | processed | ignored | |
PERSISTENCE_CONTEXT_* | eclipselink.persistence-context.* | processed | ignored | |
ALLOW_ZERO_ID | eclipselink.allow-zero-id | processed | ignored | |
SESSION_CUSTOMIZER | eclipselink.session.customizer | processed | processed | Members' customizers processed before composite customizer. |
SESSIONS_XML | eclipselink.sessions-xml | exception | processed | Composite can't be read from sessions.xml - exception will be thrown. Note that a non-composite persistence unit should be able to use a SessionBroker defined in sessions.xml (not tested, but should work). |
JTA_DATASOURCE | javax.persistence.jtaDataSource | ignored | processed | |
NON_JTA_DATASOURCE | javax.persistence.nonJtaDataSource | ignored | processed | |
NATIVE_SQL | eclipselink.jdbc.native-sql | ignored | processed | |
SQL_CAST | eclipselink.jdbc.sql-cast | ignored | processed | |
JDBC_* | javax.persistence.jdbc.* eclipselink.jdbc.* | ignored | processed | |
CONNECTION_POOL_* | ignored | processed | ||
PARTITIONING.* | eclipselink.partitioning.* | ignored | processed | |
EXCLUSIVE_CONNECTION_* | eclipselink.jdbc.exclusive-connection.* | ignored | processed | |
CACHE.* | eclipselink.cache.* | ignored | processed | |
TARGET_DATABASE | eclipselink.target-database | ignored | processed | |
TABLE_CREATION_SUFFIX | eclipselink.ddl-generation.table-creation-suffix | ignored | processed | |
EXCLUDE_ECLIPSELINK_ORM_FILE | eclipselink.exclude-eclipselink-orm | ignored | processed | |
WEAVING | eclipselink.weaving | processed | ignored | Composite switches weaving on and off for all members. |
WEAVING_* | eclipselink.weaving.* | ignored | processed | If the weaving is on then members use their own weaving properties. |
DESCRIPTOR_CUSTOMIZER_* | eclipselink.descriptor.customizer.* | ignored | processed | TODO? Should we follow the same pattern as SessionCustomizer and process composite's DescriptorCustomizers after members' ones? |
NATIVE_QUERY_UPPERCASE_COLUMNS | eclipselink.jdbc.uppercase-columns | ignored | processed | |
UPPERCASE_COLUMN_NAMES | eclipselink.jpa.uppercase-column-names | ignored | processed | |
BATCH_WRITING.* | eclipselink.jdbc.batch-writing.* | ignored | processed | |
SESSION_EVENT_LISTENER_CLASS | eclipselink.session-event-listener | processed | processed | EventListener defined by a composite member won't receive evens risen by a UnitOfWork - only events risen by it's member. Also see bug 348759. EventListener specified by composite will receive all event (risen by either unit of work or members). |
EXCEPTION_HANDLER_CLASS | eclipselink.exception-handler | processed | processed | First ExceptionHandler specified by member handles exception. If it is not specified or fails then composite's ExceptionHandler handles the original exception. |
INCLUDE_DESCRIPTOR_QUERIES | eclipselink.session.include.descriptor.queries | ignored | processed | |
ID_VALIDATION | eclipselink.id-validation | ignored | processed | |
TEMPORAL_MUTABLE | eclipselink.temporal.mutable | ignored | processed | |
ORM_SCHEMA_VALIDATION | eclipselink.orm.validate.schema | ignored | processed | |
DDL_* | ignored | processed | ||
PESSIMISTIC_LOCK_TIMEOUT | javax.persistence.lock.timeout | ignored | processed | |
QUERY_TIMEOUT | javax.persistence.query.timeout | ignored | processed | |
ORACLE_PROXY_TYPE | eclipselink.oracle.proxy-type | ignored | processed |
Entity Manager Properties
- Composite Entity Manager property could be directly passed to createEntityManager method or setProperty method
- Composite member property could be passed to the same methods through "eclipselink.composite.properties" property.
EntityManagerProperties. | property name | composite pu | composite member pu | comment |
COMPOSITE_PROPERTIES | eclipselink.composite.properties | processed | ignored | |
FLUSH_CLEAR_CACHE | eclipselink.flush-clear.cache | processed | ignored | |
VALIDATE_EXISTENCE | eclipselink.validate-existence | processed | ignored | |
JOIN_EXISTING_TRANSACTION | eclipselink.transaction.join-existing | processed | ignored | |
PERSISTENCE_CONTEXT_* | eclipselink.persistence-context.* | processed | ignored | |
ORDER_UPDATES | eclipselink.order-updates | processed | ignored | |
EXCLUSIVE_CONNECTION_* | eclipselink.jdbc.exclusive-connection.* | ignored | processed | |
JDBC_DRIVER | javax.persistence.jdbc.driver | ignored | processed | |
JDBC_URL | javax.persistence.jdbc.url | ignored | processed | |
JDBC_USER | javax.persistence.jdbc.user | ignored | processed | |
JDBC_PASSWORD | javax.persistence.jdbc.password | ignored | processed | |
JTA_DATASOURCE | javax.persistence.jtaDataSource | ignored | processed | |
NON_JTA_DATASOURCE | javax.persistence.nonJtaDataSource | ignored | processed | |
CONNECTION_POLICY | eclipselink.jdbc.connection-policy | ignored | processed | |
ORACLE_PROXY_TYPE | eclipselink.oracle.proxy-type | ignored | processed |
Limitations
- Main limitations' cause is that tables in different data bases cannot be joined in a query. Examples:
- Entities mapped in different composite members could not be joined in a query.
- If deletion of an entity causes deletion from a table that is mapped by another composite member then delete all query can't be performed.
- Therefore delete all cannot be used if an entity
- has ElementCollection mapped in another composite member,
- owns bidirectional relationship with a JoinTable with target mapped in another composite member,
- has any reference mapping that is privately owned with target mapped in another composite member.
- Therefore delete all cannot be used if an entity
- Inheritance hierarchy cannot be shared between different composite members.
- If target of a reference mapping is defined in a different composite member and JoinTable is used, then the join table must belong to the target composite member.
- Such mappings must be unidirectional - the "invert" mapping cannot use "mappedBy".
- That's because JoinTable must be defined in the same composite member with target entity: master mapping requires it to be in slave's member, slave mapping - in master's.
- Workaround is to define independent invert mapping with its own JoinTable.
- If user maintains both sides of the relationship then the two join tables will be in sync.
- Such mappings must be unidirectional - the "invert" mapping cannot use "mappedBy".
- Native query created without result class must specify the target composite member persistence unit.
em.createNativeQuery("SELECT F_NAME FROM MBR2_EMPLOYEE").setHint(QueryHints.COMPOSITE_UNIT_MEMBER, "composite-advanced-member_2").getResultList();
Extensions
- User can specify ElementCollection with primitive type target values with CollectionTable defined in a different composite member persistence unit using
- Annotations
@ElementCollection() @CollectionTable(name = "MBR1_RESPONS", joinColumns=@JoinColumn(name="EMP_ID")) @CompositeMember("composite-advanced-member_1") @Column(name = "DESCRIPTION") public Collection<String> getResponsibilities() { return responsibilities; }
- eclipselink-orm.xml
<element-collection name="responsibilities" composite-member="xml-composite-advanced-member_3"> <column name="DESCRIPTION"/> <collection-table name="XML_MBR3_RESPONS"> <join-column name="EMP_ID"/> </collection-table> </element-collection>
- No @CompositeMember annotation (or composite-member attribute) is required if CollectionTable is defined in the same composite member persistence unit as the source.
Documentation
Open Issues
This section lists the open issues that are still pending that must be decided prior to fully implementing this project's requirements.
Issue # | Description / Notes |
---|---|
1 | Should this feature include both split and aggregated persistence units? NO split support. |
2 | In the case of split persistence units where should the additional Data Sources be defined? PU properties in persistence.xml, eclipselink-orm.xml, both? Since it is possible for different Data Sources to be different database vendors or versions it should be possible to configure all JDBC/connection/pool level options on each data source. NO split support. |
3 | Should this feature include support to customize additional Data Sources with persistence unit properties. NO split support. |
4 | In the case of aggregate persistence units, should persistence units be usable on their own. YES, if independent. |
Decisions
This section lists decisions made. These are intended to document the resolution of open issues or constraints added to the project that are important.
Issue # | Description / Notes | Decision |
---|---|---|
Known problems in 2.3
- bug 348759 - SessionBroker's member sessions get postLogin event before descriptors initialized - Fixed in 2.3.1
- bug 348815 - Composite persistence unit does not process VALIDATION_ONLY_PROPERTY correctly - Fixed in 2.3.1