Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "SMILA/Documentation"
< SMILA
| Line 7: | Line 7: | ||
== The SMILA Development Environment == | == The SMILA Development Environment == | ||
| − | * [[SMILA/ | + | * [[SMILA/Documentation/HowTo/Howto_set_up_dev_environment|Setup your Eclipse IDE for SMILA]] |
| − | * [[SMILA/ | + | * [[SMILA/Documentation/HowTo/Howto_build_a_SMILA-Distribution|Build SMILA]] |
| − | * [[SMILA/ | + | * [[SMILA/Documentation/HowTo/Create_a_bundle_(plug-in)|Creating new components]] |
| − | * [[SMILA/ | + | * [[SMILA/Documentation/HowTo/Create_a_test_bundle_(plug-in)|Testing new components]] |
| − | * [[SMILA/ | + | * [[SMILA/Documentation/HowTo/3rd_party_bundle|Adding Third Party libraries to SMILA]] |
| − | * [[SMILA/ | + | * [[SMILA/Documentation/HowTo/Declarative_Services|Using OSGi Declarative Services]] |
* Extending the build process: | * Extending the build process: | ||
| − | ** [[SMILA/ | + | ** [[SMILA/Documentation/HowTo/How_to_integrate_new_bundle_into_build_process|Adding a new component bundle to the build]] |
| − | ** [[SMILA/ | + | ** [[SMILA/Documentation/HowTo/How_to_integrate_test_bundle_into_build_process|Adding a new test bundle to the build]] |
== Pipelines and Pipelets: Synchronous Workflows of Java components == | == Pipelines and Pipelets: Synchronous Workflows of Java components == | ||
* [[SMILA/Documentation/Pipelets|What are Pipelines? What are Pipelets?]] | * [[SMILA/Documentation/Pipelets|What are Pipelines? What are Pipelets?]] | ||
* [[SMILA/Documentation/BPEL_Workflow_Processor|Configuration and Creating BPEL Pipelines]] | * [[SMILA/Documentation/BPEL_Workflow_Processor|Configuration and Creating BPEL Pipelines]] | ||
| − | ** [[SMILA/ | + | ** [[SMILA/Documentation/HowTo/How_to_filter_and_access_record_data_in_BPEL|Accessing SMILA records in BPEL activities]] |
* [[SMILA/BPEL_Designer|Using the SMILA BPEL Designer]] | * [[SMILA/BPEL_Designer|Using the SMILA BPEL Designer]] | ||
* ReST APIs | * ReST APIs | ||
| Line 30: | Line 30: | ||
** More special pipelets are provided by components described below. | ** More special pipelets are provided by components described below. | ||
* Developing Pipelets | * Developing Pipelets | ||
| − | ** [[SMILA/ | + | ** [[SMILA/Documentation/HowTo/How_to_write_a_Pipelet|How to write a pipelet]] |
** [[SMILA/Documentation/Usage_of_Blackboard_Service|BlackboardService]] | ** [[SMILA/Documentation/Usage_of_Blackboard_Service|BlackboardService]] | ||
| Line 56: | Line 56: | ||
* Developing Workers | * Developing Workers | ||
** [[SMILA/Documentation/WorkerManager|WorkerManager: Workers made easy]] | ** [[SMILA/Documentation/WorkerManager|WorkerManager: Workers made easy]] | ||
| − | ** [[SMILA/ | + | ** [[SMILA/Documentation/HowTo/How_to_write_a_Worker|How to write a worker]] |
** [[SMILA/Documentation/TaskGenerators|Task Generators]] | ** [[SMILA/Documentation/TaskGenerators|Task Generators]] | ||
| Line 69: | Line 69: | ||
** [[SMILA/Documentation/Importing/VisitedLinks | VisitedLinks service]] | ** [[SMILA/Documentation/Importing/VisitedLinks | VisitedLinks service]] | ||
** [[SMILA/Documentation/Importing/Crawler/Web#Internal_structure|Extending the WebCrawler worker]] | ** [[SMILA/Documentation/Importing/Crawler/Web#Internal_structure|Extending the WebCrawler worker]] | ||
| − | ** [[SMILA/ | + | ** [[SMILA/Documentation/HowTo/How to add a new Data Source to the importing framework|How to add a new '''Data Source''' to the SMILA importing framework]] |
== The SMILA HTTP Server == | == The SMILA HTTP Server == | ||
| Line 107: | Line 107: | ||
***[[SMILA/Documentation/CompoundManagement|CompoundManagement]] | ***[[SMILA/Documentation/CompoundManagement|CompoundManagement]] | ||
** Developing | ** Developing | ||
| − | *** [[SMILA/ | + | *** [[SMILA/Documentation/HowTo/How_to_implement_a_Crawler|How to implement a crawler]] |
| − | *** [[SMILA/ | + | *** [[SMILA/Documentation/HowTo/How_to_implement_an_agent|How to implement an agent]] |
** [[SMILA/Documentation/Management|JMX Management]] | ** [[SMILA/Documentation/Management|JMX Management]] | ||
*** [[SMILA/Documentation/Management#JMX_Client|JMX Clients]] | *** [[SMILA/Documentation/Management#JMX_Client|JMX Clients]] | ||
Revision as of 09:32, 24 January 2012
Contents
Basics
- Architecture
- Overview on Default Configuration
- Data Model, XML, JSON, BON
- Using the ReST API
- REST API Reference
The SMILA Development Environment
- Setup your Eclipse IDE for SMILA
- Build SMILA
- Creating new components
- Testing new components
- Adding Third Party libraries to SMILA
- Using OSGi Declarative Services
- Extending the build process:
Pipelines and Pipelets: Synchronous Workflows of Java components
- What are Pipelines? What are Pipelets?
- Configuration and Creating BPEL Pipelines
- Using the SMILA BPEL Designer
- ReST APIs
- Basic Pipelets
- Common pipelets: bundle org.eclipse.smila.processing.pipelets
- Common XML pipelets: Bundle org.eclipse.smila.processing.pipelets.xmlprocessing
- More special pipelets are provided by components described below.
- Developing Pipelets
Using SMILA for Search
JobManager: Asynchronous Workflows
- Concepts: Jobs and Tasks
- Creating Workflows and Jobs
- Running and Monitoring Jobs
- JobManager Configuration
- TaskManager: Asynchronous scheduling of tasks
- Workers Reference
- Bulkbuilder
- PipelineProcesor
- PipeletProcessor
- See Importing below for more workers
- Developing Workers
Importing
- Concepts
- Importing Workers reference
- Developing Importing Workers
The SMILA HTTP Server
Common Services
- Configuration Helper
- Workspace Helper
- ClusterConfig service
- ObjectStore
- BinaryStorage
- Processing security information
- Ontology processing with Sesame: Configuration and Pipelets
- MimeTypeIdentifier
- Publishing Web Services
- General JPA Configuration in SMILA