COSMOS Design 208593

Internationalization Support - programming model

Change History

Name:	Date:	Revised Sections:
Jimmy Mohsin	01/3/2008	Initial version

Workload Estimation

Rough workload estimate in person weeks

Process	Sizing	Names of people doing the work
Design	1	Jimmy Mohsin
Code (not part of this ER)	4	Dev Team
Test (not part of this ER)	4	QA Team
Documentation (not part of this ER)	1
Build and infrastructure (not part of this ER)	1
Code review, etc. (not part of this ER)	1
TOTAL	12

Terminologies/Acronyms

The terminologies/acronyms below are commonly used throughout this document. The list below defines each term regarding how it is used in this document:

Term	Definition
Internationalization	The process of generalizing the design of a product so that it can handle multiple languages and cultural conventions without the need for making code changes for each language. COSMOS 1.0 will be internationalized for its eventual adoption and deployment
Localization	The process of taking an internationalized product and making it linguistically and culturally appropriate to the target locale (country/region and language) where it will be used. COSMOS 1.0 will not be localized for any non-US English languages, this is something that the adopers will need to do.
Translatable Elements	Everything intended to be locale and language dependent. These items may need to be modified for different locales, e.g. date formats, time formats, word lists for content controls, and so on.
Non-user elements	Everything not intended for end-users to see and understand. This fits into two categories, proper names and internal elements. Examples of internal elements are command line commands and options, debug strings, registry keys, program file names, comments, and so on. Examples of proper names are product name, company name, and so on.
User Elements	Everything intended for end-users to see and understand, e.g. menus and menu items, dialog boxes, windows, program groups, error messages, installation scripts, icons, buttons, "Display Name" and "Description" fields for services we create on Windows, and so on.

Purpose

This enhancement is associated with bugzilla 208593.

The data visualization component does not follow a consisten design pattern to support internationalization. There are serveral components within the visualization project that require internationalization support:

1. Dojo widgets
2. Servlet data feeds
3. XML configuration files
4. ANY OTHER COMPONENTS ???

Dojo widgets do support i18n, as documented on http://dojo.jot.com/WikiHome/Internationalization?revision=18 For each of these components there are best practices to support internationalization; however, a common methodology is needed.

CMDBfQueryService.jar will contain the necessary code for processing a query that conforms to CMDBf. This set will allow the user to provide implementation of selector handlers that are specific to a data provider. CMDBfQueryService.jar cannot be used as-is and will require a minimum API set to be implemented. Similarly, CMDBfRegistrationService.jar can be used by contributors to help in processing a registration request.

Requirements

The following is the list of requirements that this enhancement will address:

1. Checking the conformance of a CMDBf query against its schema
2. Checking the conformance of a CMDBf registration request against its schema
3. Transformation of CMDBf XML query from/to a POJO representation
4. Transformation of CMDBf XML registration from/to a POJO representation
5. A common method of processing a CMDBf query
6. A common method of processing a registration request

Implementation Details

The COSMOS code must meet the following considerations to support i18n:

1. Externalize all translatable elements(i.e. no hardcoding)
2. Put translatable elements in language modules separated from executables
3. Generalize design to support any language
4. Dynamically select and load language module at run time

Transformations

Query

CMDBf specifies an XML-based syntax by which queries are submitted to the query service, which reports back a query result from the available MDRs, also using XML syntax. As part of our implementation of the query service, we internally accept POJOs to represent a graph of the query, and return the query result as a set of POJOs. The job of the transformers is to convert POJOs to and from the XML syntax detailed in the CMDBf specification.

As part of COSMOS Design 200222, a set of query transformations and an SML-repository-specific query service were designed and implemented. In an effort to make these components reusable, the query transformations will be refactored to share common components needed by other libraries in this design. The initial candidate classes to be moved to the common module are IXMLWritable, QueryServiceUtil (which will be renamed) and some of the fields in IQueryTransformerConstants (the ones pertaining to character constants and general SAX parsing).

In addition, the previously implemented packages will be renamed to include the word "provisional", which in the API contract specifications we are reusing from the TPTP project, indicates that the APIs are experimental and will be evolved into stable public APIs.

Here is a simple example that illustrates the incoming query input transformation:

InputStream inputStream = new ByteArrayInputStream(example1().getBytes());
Query query = QueryInputTransformer.transform(inputStream);

Assume that example1() returns a String containing the XML syntax for a <query> as specified in the CMDBf spec.

Registration

CMDBf specifies a registration service by which MDRs register items and relationships with the federating CMDB. The process for registration involves an XML-based transaction, similar to how the query service works. This enhancement will provide a transformer to convert a registration request from XML to a POJO graph structure, and will also provide the reverse of that transformation. In addition, it will provide another transformer that will convert a registration response output by the MDR from a POJO graph structure to the XML-based syntax expected by the CMDBf spec, and will again provide a reverse of that transformation. The reverse transformations are needed by some clients of the registration service, and also are useful in unit testing of the implementation.

The following new classes will provide these transformations:

org.eclipse.cosmos.dc.cmdbf.services.provisional.registration.transform.RegistrationInputTransformer
org.eclipse.cosmos.dc.cmdbf.services.provisional.registration.transform.RegistrationOutputTransformer

The following are the transformation APIs on the RegistrationInputTransformer class:

static public RegisterRequest transform(InputStream)
static public InputStream transform(RegisterRequest)

The following are the transformation APIs on the RegistrationOutputTransformer class:

static public RegisterResponse transform(InputStream)
static public InputStream transform(RegisterResponse)

RegisterRequest and RegisterResponse POJOs will consist of APIs and classes that match or closely mirror the corresponding element names in the CMDBf data model. RegisterRequest will reside in the org.eclipse.cosmos.dc.cmdbf.services.provisional.registration.transform.input.artifacts package and RegisterResponse will live in the org.eclipse.cosmos.dc.cmdbf.services.provisional.registration.transform.response.artifacts package.

Here is a simple example that illustrates the incoming registration input transformation:

InputStream inputStream = new ByteArrayInputStream(example1().getBytes());
RegisterRequest registerRequest = RegistrationInputTransformer.transform(inputStream);

Assume that example1() returns a String containing the XML syntax for a <registerRequest> as specified in the CMDBf spec.

Services

Query

The class diagram below displays the interfaces and default implementations that will be included for the query service. All that a contributor is required to do is to register the classes that will be used as handlers for the selectors. The default implementation of the CMDBf query operation will look up the appropriate handlers and will invoke them accordingly.

The following is a snippet of code that illustrates how a contributor can register a set of selector handlers with the default implementation of ISelectorHandlerFactory.:

 SelectorHandlerFactory.getInstance().addHandlers
 (
        new URI ("http://cosmos.org/mdrId"), 
        ISelectorHandlerFactory.ITEM_TEMPLATE,
        new String[]
        {
             "org.eclipse.cosmos.sample.handlers.InstanceIdHandler",
             "org.eclipse.cosmos.sample.handlers.RecordTypeHandler",
             "org.eclipse.cosmos.sample.handlers.PropertyValueHandler",
             "org.eclipse.cosmos.sample.handlers.XPath1Handler"
        }
 );

Once the selectors are registered a client can make use of the CMDBf query service using the default implementation of ICMDBfQueryOperation. The argument passed into the initialize method represents a data provider that will be passed to each of the selector handlers. The selector handlers can cast the argument to a specific type that can process native queries that is understandable by a specific data provider. The following snippet of code illustrates how the query operation can be invoked:

 // Create a CMDBf query operation object and have it initialized
 CMDBfQueryOperation cmdbfQueryOperation = new CMDBfQueryOperation();
 cmdbfQueryOperation.initialize(new SampleDataProvider());
		
 // Execute the query
 Query query = retrieveQuery();
 cmdbfQueryOperation.execute(query);	

Assuming retrieveQuery() will return a POJO representation of a CMDBf query.

Registration

The diagram below shows the relationship between the classes of the registration service. The APIs are very symmetric to the ones provided for the query service. An adopter will need to subscribe register handlers for specific MDR IDs. The subscribed register handlers will be invoked if the MDR ID of the registration request matches that of the ID associated with the handler.

The snippet of code below shows how a client can subscribe a registration handler. CustomRegistrationHandler is expected to be an implementation of IRegisterHandler.

 RegisterHandlerSubscription.getInstance().addHandler
 (
      new URI("http://cosmos.org/mdrId"), 
      new CustomRegistrationHandler()
 );

The default implementation of ICMDBfRegistrationOperation can be used to process a registration request. The snippet below shows how a client can use the operation:

 // Perform the initialization
 CMDBfRegistrationOperation registrationOperation = new CMDBfRegistrationOperation();
 registrationOperation.initialize(new SampleDataProvider());
	
 // Execute the operation
 Registration registration = retrieveRegistration();
 registrationOperation.execute(registration);

Assuming retrieveRegistration() will return a POJO representation of a CMDBf registration request.

Test Coverage

Unit tests will need to perform the following tests:

• Transform a RegisterRequest POJO to XML and back to a POJO, and compare the start and end POJOs
• Transform a RegisterResponse POJO to XML and back to a POJO, and compare the start and end POJOs
• Process an empty query
• Processing a query with just one item
• Processing a query with a relationship and no items
• Processing a query with matching items and an unmatched relationship
• Processing a query with matching items and a matched relationship
• Processing a query with a relationship that has cardinality
• Processing a query with unregistered selector handlers
• Processing an empty registration request
• Processing a registration request with one item
• Processing a registration request with matched items and missing relationship
• Processing a registration request with matched items and a relationship
• Processing a registration request with a relationship and no items
• Processing a registration request with missing registration handlers

Task Breakdown

The following section includes the tasks required to complete this enhancement .

1. Refactor plugin, package and class names in cmdbf.query plugin to represent the 5 different jar configurations
2. Refactor the JUnits for the query transformation
3. Create graph representation of registration request and response
4. Create the registration input transformer
5. Create the registration output transformer
6. Add in JUnits for the registration transformer
7. Add in the APIs for processing a CMDBf query
8. Implement a generic implementation of the CMDBf query processor
9. Add in JUnits for the CMDBf query APIs
10. Modify the SML repository to make use of the new API set
11. Add in the APIs for processing a CMDBf registration request
12. Implement a generic implementation of the CMDBf registration processor
13. Add in JUnits for the registration APIs

Open Issues/Questions

All reviewer feedback should go in the Talk page for 208593.

• Should this ER address the Language Groups issue? Or should this be deemed out of scope since COSMOS 1.0 will not address localization?
• Where does XLIFF fit into the i18n considerations? http://docs.oasis-open.org/xliff/v1.2/cs02/xliff-core.html

---