Difference between revisions of "SMILA/Documentation"

From Eclipsepedia

Jump to: navigation, search
(Basics)
m
Line 1: Line 1:
 
== Basics ==
 
== Basics ==
 
* [[SMILA/Documentation/Architecture_Overview|Architecture]]
 
* [[SMILA/Documentation/Architecture_Overview|Architecture]]
* [[SMILA/Documentation/Default_configuration_workflow_overview|Overview on Default Configuration]]
+
* [[SMILA/Documentation/Default_configuration_workflow_overview|Overview of Default Configuration]]
 
* [[SMILA/Documentation/Data_Model_and_Serialization_Formats|Data Model, XML, JSON, BON]]
 
* [[SMILA/Documentation/Data_Model_and_Serialization_Formats|Data Model, XML, JSON, BON]]
 
* [[SMILA/Documentation/Using_The_ReST_API|Using the ReST API]]
 
* [[SMILA/Documentation/Using_The_ReST_API|Using the ReST API]]
 
* [[SMILA/Documentation/REST_API_Reference|REST API Reference]]
 
* [[SMILA/Documentation/REST_API_Reference|REST API Reference]]
* [[SMILA/Documentation/Enable Remote Access|Enabling remote access to SMILA]]
+
* [[SMILA/Documentation/Enable Remote Access|Enabling Remote Access to SMILA]]
  
 
== The SMILA Development Environment ==
 
== The SMILA Development Environment ==
* [[SMILA/Documentation/HowTo/Howto_set_up_dev_environment|Setup your Eclipse IDE for SMILA]]
+
* [[SMILA/Documentation/HowTo/Howto_set_up_dev_environment|Setting up your Eclipse IDE for SMILA]]
* [[SMILA/Documentation/HowTo/Howto_build_a_SMILA-Distribution|Build SMILA]]
+
* [[SMILA/Documentation/HowTo/Howto_build_a_SMILA-Distribution|Building SMILA]]
* [[SMILA/Documentation/HowTo/Create_a_bundle_(plug-in)|Creating new components]]
+
* [[SMILA/Documentation/HowTo/Create_a_bundle_(plug-in)|Creating new Components]]
* [[SMILA/Documentation/HowTo/Create_a_test_bundle_(plug-in)|Testing new components]]
+
* [[SMILA/Documentation/HowTo/Create_a_test_bundle_(plug-in)|Testing new Components]]
* [[SMILA/Documentation/HowTo/3rd_party_bundle|Adding Third Party libraries to SMILA]]
+
* [[SMILA/Documentation/HowTo/3rd_party_bundle|Adding Third Party Libraries to SMILA]]
 
* [[SMILA/Documentation/Declarative_Services|Using OSGi Declarative Services]]
 
* [[SMILA/Documentation/Declarative_Services|Using OSGi Declarative Services]]
 
* Extending the build process:
 
* Extending the build process:
** [[SMILA/Documentation/HowTo/How_to_integrate_new_bundle_into_build_process|Adding a new component bundle to the build]]
+
** [[SMILA/Documentation/HowTo/How_to_integrate_new_bundle_into_build_process|Adding a new Component Bundle to the Build]]
** [[SMILA/Documentation/HowTo/How_to_integrate_test_bundle_into_build_process|Adding a new test bundle to the build]]
+
** [[SMILA/Documentation/HowTo/How_to_integrate_test_bundle_into_build_process|Adding a new Test Bundle to the Build]]
  
 
== Pipelines and Pipelets: Synchronous Workflows of Java components ==
 
== Pipelines and Pipelets: Synchronous Workflows of Java components ==
 
* [[SMILA/Documentation/Pipelets|What are Pipelines? What are Pipelets?]]
 
* [[SMILA/Documentation/Pipelets|What are Pipelines? What are Pipelets?]]
* [[SMILA/Documentation/BPEL_Workflow_Processor|Configuration and Creating BPEL Pipelines]]
+
* [[SMILA/Documentation/BPEL_Workflow_Processor|Configuring and Creating BPEL Pipelines]]
 
** [[SMILA/Documentation/HowTo/How_to_filter_and_access_record_data_in_BPEL|Accessing SMILA records in BPEL activities]]
 
** [[SMILA/Documentation/HowTo/How_to_filter_and_access_record_data_in_BPEL|Accessing SMILA records in BPEL activities]]
 
* [[SMILA/BPEL_Designer|Using the SMILA BPEL Designer]]
 
* [[SMILA/BPEL_Designer|Using the SMILA BPEL Designer]]
 
* ReST APIs
 
* ReST APIs
** [[SMILA/Documentation/Processing/JSON_REST_API_for_pipelets|for showing pipelets]]
+
** [[SMILA/Documentation/Processing/JSON_REST_API_for_pipelets|For showing pipelets]]
** [[SMILA/Documentation/Processing/JSON_REST_API_for_BPEL_pipelines|for showing, manipulating and executing pipelines]]
+
** [[SMILA/Documentation/Processing/JSON_REST_API_for_BPEL_pipelines|For showing, manipulating, and executing pipelines]]
 
* Basic Pipelets
 
* Basic Pipelets
** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets|Common pipelets: bundle org.eclipse.smila.processing.pipelets]]  
+
** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets|Common Pipelets in Bundle org.eclipse.smila.processing.pipelets]]  
** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets.xmlprocessing|Common XML pipelets: Bundle org.eclipse.smila.processing.pipelets.xmlprocessing]]
+
** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets.xmlprocessing|XML Processing Pipelets in Bundle org.eclipse.smila.processing.pipelets.xmlprocessing]]
** More special pipelets are provided by components described below.
+
** More special pipelets are provided by the components described below.
 
* Developing Pipelets  
 
* Developing Pipelets  
** [[SMILA/Documentation/HowTo/How_to_write_a_Pipelet|How to write a pipelet]]
+
** [[SMILA/Documentation/HowTo/How_to_write_a_Pipelet|How to Write a Pipelet]]
** [[SMILA/Documentation/Usage_of_Blackboard_Service|BlackboardService]]
+
** [[SMILA/Documentation/Usage_of_Blackboard_Service|Using the Blackboard Service]]
  
 
== Using SMILA for Search ==
 
== Using SMILA for Search ==
Line 41: Line 41:
 
== JobManager: Asynchronous Workflows ==
 
== JobManager: Asynchronous Workflows ==
 
* [[SMILA/Documentation/JobManager|Concepts: Jobs and Tasks]]
 
* [[SMILA/Documentation/JobManager|Concepts: Jobs and Tasks]]
** [[SMILA/Documentation/JobManagerFirstExample|A simple example]]
+
** [[SMILA/Documentation/JobManagerFirstExample|A Simple Example]]
 
* Creating Workflows and Jobs
 
* Creating Workflows and Jobs
 
** [[SMILA/Documentation/DataObjectTypesAndBuckets|Defining Buckets]]
 
** [[SMILA/Documentation/DataObjectTypesAndBuckets|Defining Buckets]]
 
** [[SMILA/Documentation/WorkerAndWorkflows|Modeling Workflows]]
 
** [[SMILA/Documentation/WorkerAndWorkflows|Modeling Workflows]]
 
** [[SMILA/Documentation/JobDefinitions|Creating Jobs]]
 
** [[SMILA/Documentation/JobDefinitions|Creating Jobs]]
** [[SMILA/Documentation/JobParameters|Evaluation of Job Parameters]]
+
** [[SMILA/Documentation/JobParameters|Evaluating of Job Parameters]]
 
* [[SMILA/Documentation/JobRuns|Running and Monitoring Jobs]]
 
* [[SMILA/Documentation/JobRuns|Running and Monitoring Jobs]]
* [[SMILA/Documentation/JobManagerConfiguration|JobManager Configuration]]
+
* [[SMILA/Documentation/JobManagerConfiguration|Configuring the Job Manager]]
* [[SMILA/Documentation/TaskManager|TaskManager: Asynchronous scheduling of tasks]]
+
* [[SMILA/Documentation/TaskManager|TaskManager: Asynchronous Scheduling of Tasks]]
* Workers Reference
+
* Worker Reference
** [[SMILA/Documentation/Bulkbuilder|Bulkbuilder]]
+
** [[SMILA/Documentation/Bulkbuilder|Bulkbuilder worker]]
** [[SMILA/Documentation/Worker/PipelineProcessorWorker|PipelineProcesor]]
+
** [[SMILA/Documentation/Worker/PipelineProcessorWorker|PipelineProcesor Worker]]
** [[SMILA/Documentation/Worker/PipeletProcessorWorker|PipeletProcessor]]
+
** [[SMILA/Documentation/Worker/PipeletProcessorWorker|PipeletProcessor Worker]]
 
** See [[SMILA/Manual#Importing|Importing]] below for more workers
 
** See [[SMILA/Manual#Importing|Importing]] below for more workers
 
* Developing Workers
 
* Developing Workers
** [[SMILA/Documentation/WorkerManager|WorkerManager: Workers made easy]]
+
** [[SMILA/Documentation/WorkerManager|WorkerManager: Workers Made Easy]]
** [[SMILA/Documentation/HowTo/How_to_write_a_Worker|How to write a worker]]
+
** [[SMILA/Documentation/HowTo/How_to_write_a_Worker|How to Write a Worker]]
 
** [[SMILA/Documentation/TaskGenerators|Task Generators]]
 
** [[SMILA/Documentation/TaskGenerators|Task Generators]]
  
Line 63: Line 63:
 
* [[SMILA/Documentation/Importing/Concept|Concepts]]
 
* [[SMILA/Documentation/Importing/Concept|Concepts]]
 
* Importing Workers reference
 
* Importing Workers reference
**[[SMILA/Documentation/Importing/Crawler/File | FileCrawler and FileFetcher worker]]
+
**[[SMILA/Documentation/Importing/Crawler/File | FileCrawler and FileFetcher Worker]]
**[[SMILA/Documentation/Importing/Crawler/Web | WebCrawler and WebFetcher worker]]
+
**[[SMILA/Documentation/Importing/Crawler/Web | WebCrawler and WebFetcher Worker]]
**[[SMILA/Documentation/Importing/DeltaCheck | DeltaCheck worker]]
+
**[[SMILA/Documentation/Importing/DeltaCheck | DeltaChecker Worker]]
**[[SMILA/Documentation/Importing/UpdatePusher | UpdatePusher worker]]
+
**[[SMILA/Documentation/Importing/UpdatePusher | UpdatePusher Worker]]
 
* Developing Importing Workers
 
* Developing Importing Workers
 
** [[SMILA/Documentation/Importing/VisitedLinks | VisitedLinks service]]
 
** [[SMILA/Documentation/Importing/VisitedLinks | VisitedLinks service]]
 
** [[SMILA/Documentation/Importing/Crawler/Web#Internal_structure|Extending the WebCrawler worker]]
 
** [[SMILA/Documentation/Importing/Crawler/Web#Internal_structure|Extending the WebCrawler worker]]
** [[SMILA/Documentation/HowTo/How to add a new Data Source to the importing framework|How to add a new '''Data Source''' to the SMILA importing framework]]
+
** [[SMILA/Documentation/HowTo/How to add a new Data Source to the importing framework|Adding a Data Source to the SMILA Importing Framework]]
  
 
== The SMILA HTTP Server ==
 
== The SMILA HTTP Server ==
* [[SMILA/Documentation/JettyHttpServer|Configuration of Jetty]]
+
* [[SMILA/Documentation/JettyHttpServer|Configuring Jetty]]
* [[SMILA/Documentation/JettyHttpServer#JSON_Handlers|Developing JSON ReST handlers for SMILA]]
+
* [[SMILA/Documentation/JettyHttpServer#JSON_Handlers|Developing JSON ReST Handlers for SMILA]]
  
 
== Common Services ==
 
== Common Services ==
 
* [[SMILA/Project Concepts/Simple configuration handler|Configuration Helper]]
 
* [[SMILA/Project Concepts/Simple configuration handler|Configuration Helper]]
 
* [[SMILA/Documentation/Workspace Handling|Workspace Helper]]
 
* [[SMILA/Documentation/Workspace Handling|Workspace Helper]]
* [[SMILA/Documentation/Bundle_org.eclipse.smila.clusterconfig|ClusterConfig service]]
+
* [[SMILA/Documentation/Bundle_org.eclipse.smila.clusterconfig|ClusterConfig Service]]
** [[SMILA/Documentation/Bundle_org.eclipse.smila.clusterconfig.simple|Simple implementation]]
+
** [[SMILA/Documentation/Bundle_org.eclipse.smila.clusterconfig.simple|Simple Implementation]]
 
* [[SMILA/Documentation/ObjectStore/Bundle_org.eclipse.smila.objectstore|ObjectStore]]
 
* [[SMILA/Documentation/ObjectStore/Bundle_org.eclipse.smila.objectstore|ObjectStore]]
** [[SMILA/Documentation/ObjectStore/Bundle_org.eclipse.smila.objectstore.filesystem|Filesystem Objectstore implementation]]
+
** [[SMILA/Documentation/ObjectStore/Bundle_org.eclipse.smila.objectstore.filesystem|Filesystem Objectstore Implementation]]
 
* [[SMILA/Documentation/Binary_Storage|BinaryStorage]]
 
* [[SMILA/Documentation/Binary_Storage|BinaryStorage]]
* [[SMILA/Documentation/Security|Processing security information]]
+
* [[SMILA/Documentation/Security|Processing Security Information]]
 
** [[SMILA/Documentation/LDAPSecurityResolver|Implementation for using LDAP]]
 
** [[SMILA/Documentation/LDAPSecurityResolver|Implementation for using LDAP]]
 
** [[SMILA/Documentation/SecurityProcessingServices|Example Pipelets]]
 
** [[SMILA/Documentation/SecurityProcessingServices|Example Pipelets]]
* [[SMILA/Documentation/SesameOntologyManager|Ontology processing with Sesame: Configuration and Pipelets]]
+
* [[SMILA/Documentation/SesameOntologyManager|Ontology Processing with Sesame: Configuration and Pipelets]]
 
* [[SMILA/Documentation/MimeTypeIdentifier|MimeTypeIdentifier]]
 
* [[SMILA/Documentation/MimeTypeIdentifier|MimeTypeIdentifier]]
 
* [[SMILA/Documentation/PublishingJAXWSWebservices|Publishing Web Services]]
 
* [[SMILA/Documentation/PublishingJAXWSWebservices|Publishing Web Services]]

Revision as of 12:38, 25 January 2012

Contents

Basics

The SMILA Development Environment

Pipelines and Pipelets: Synchronous Workflows of Java components

Using SMILA for Search

JobManager: Asynchronous Workflows

Importing

The SMILA HTTP Server

Common Services

Deprecated Components