Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "SMILA/Documentation"
< SMILA
(added SMILA_Versioning) |
m (→Pipelines and Pipelets: Synchronous Workflows) |
||
| (10 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
== Basics == | == Basics == | ||
* [[SMILA/Documentation_for_5_Minutes_to_Success|Installing and Running]] | * [[SMILA/Documentation_for_5_Minutes_to_Success|Installing and Running]] | ||
| + | * [[SMILA/Documentation/HowTo|HowTos]] | ||
* [[SMILA/Documentation/Architecture_Overview|Architecture]] | * [[SMILA/Documentation/Architecture_Overview|Architecture]] | ||
* [[SMILA/Documentation/Default_configuration_workflow_overview|Overview of Default Configuration]] | * [[SMILA/Documentation/Default_configuration_workflow_overview|Overview of Default Configuration]] | ||
* [[SMILA/Documentation/Data_Model_and_Serialization_Formats|Data Model, XML, JSON, BON]] | * [[SMILA/Documentation/Data_Model_and_Serialization_Formats|Data Model, XML, JSON, BON]] | ||
| − | * [[SMILA/Documentation/Using_The_ReST_API|Using the | + | * [[SMILA/Documentation/Using_The_ReST_API|Using the REST API, REST Client]] |
* [[SMILA/Documentation/REST_API_Reference|REST API Reference]] | * [[SMILA/Documentation/REST_API_Reference|REST API Reference]] | ||
* [[SMILA/Documentation/Enable Remote Access|Enabling Remote Access to SMILA]] | * [[SMILA/Documentation/Enable Remote Access|Enabling Remote Access to SMILA]] | ||
| Line 32: | Line 33: | ||
** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets.xmlprocessing|XML Processing Pipelets in Bundle org.eclipse.smila.processing.pipelets.xmlprocessing]] | ** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets.xmlprocessing|XML Processing Pipelets in Bundle org.eclipse.smila.processing.pipelets.xmlprocessing]] | ||
** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets.boilerpipe|Boilerpipe Pipelets in Bundle org.eclipse.smila.processing.pipelets.boilerpipe]] | ** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets.boilerpipe|Boilerpipe Pipelets in Bundle org.eclipse.smila.processing.pipelets.boilerpipe]] | ||
| + | ** [[SMILA/Documentation/TikaPipelet|TikaPipelet in bundle org.eclipse.smila.tika]] | ||
| + | ** [[SMILA/Documentation/JdbcLoggingPipelet|JdbcLoggingPipelet in bundle org.eclipse.smila.jdbc]] | ||
** More special pipelets are provided by the components described below. | ** More special pipelets are provided by the components described below. | ||
* Developing new Pipelets | * Developing new Pipelets | ||
| Line 40: | Line 43: | ||
* [[SMILA/Documentation/Search|Search Processing and APIs]] | * [[SMILA/Documentation/Search|Search Processing and APIs]] | ||
| − | * [[SMILA/Documentation/Solr|Solr Integration: Configuration and Pipelets]] | + | * [[SMILA/Documentation/Solr 3.5|Solr Integration: Configuration and Pipelets]] |
== JobManager: Asynchronous Workflows == | == JobManager: Asynchronous Workflows == | ||
| Line 77: | Line 80: | ||
** [[SMILA/Documentation/Importing/Crawler/Web#Internal_structure|Extending the WebCrawler worker]] | ** [[SMILA/Documentation/Importing/Crawler/Web#Internal_structure|Extending the WebCrawler worker]] | ||
** [[SMILA/Documentation/HowTo/How to add a new Data Source to the importing framework|Adding a Data Source to the SMILA Import Framework]] | ** [[SMILA/Documentation/HowTo/How to add a new Data Source to the importing framework|Adding a Data Source to the SMILA Import Framework]] | ||
| + | * Additionally | ||
| + | ** [[SMILA/Documentation/Importing/CrawlingMultipleStartURLs | Crawling multiple start URL in one job run]] | ||
== Embedded HTTP Server == | == Embedded HTTP Server == | ||
| Line 99: | Line 104: | ||
* [[SMILA/Documentation/PublishingJAXWSWebservices|Publishing Web Services]] | * [[SMILA/Documentation/PublishingJAXWSWebservices|Publishing Web Services]] | ||
* [[SMILA/Documentation/General JPA Configuration in SMILA|General JPA Configuration in SMILA]] | * [[SMILA/Documentation/General JPA Configuration in SMILA|General JPA Configuration in SMILA]] | ||
| − | * [[SMILA/Documentation/SMILA_Versioning|SMILA | + | * [[SMILA/Documentation/SMILA_Versioning|SMILA Version Information]] |
== Deprecated Components == | == Deprecated Components == | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
** [[SMILA/Documentation/Management|JMX Management]] | ** [[SMILA/Documentation/Management|JMX Management]] | ||
*** [[SMILA/Documentation/Management#JMX_Client|JMX Clients]] | *** [[SMILA/Documentation/Management#JMX_Client|JMX Clients]] | ||
** [[SMILA/Documentation/Record_Storage|RecordStorage]] | ** [[SMILA/Documentation/Record_Storage|RecordStorage]] | ||
| + | |||
[[Category:SMILA]] | [[Category:SMILA]] | ||
Revision as of 12:19, 21 February 2013
Contents
Basics
- Installing and Running
- HowTos
- Architecture
- Overview of Default Configuration
- Data Model, XML, JSON, BON
- Using the REST API, REST Client
- REST API Reference
- Enabling Remote Access to SMILA
Development Environment
- Setting up your Eclipse IDE for SMILA
- Building SMILA
- Creating new Components
- Testing new Components
- Adding Third Party Libraries to SMILA
- Using OSGi Declarative Services
- Extending the build process:
Pipelines and Pipelets: Synchronous Workflows
- What are Pipelines? What are Pipelets?
- Configuring and Creating BPEL Pipelines
- Using the SMILA BPEL Designer
- ReST APIs
- Basic Pipelets
- Common Pipelets in Bundle org.eclipse.smila.processing.pipelets
- XML Processing Pipelets in Bundle org.eclipse.smila.processing.pipelets.xmlprocessing
- Boilerpipe Pipelets in Bundle org.eclipse.smila.processing.pipelets.boilerpipe
- TikaPipelet in bundle org.eclipse.smila.tika
- JdbcLoggingPipelet in bundle org.eclipse.smila.jdbc
- More special pipelets are provided by the components described below.
- Developing new Pipelets
Searching
JobManager: Asynchronous Workflows
- What are Jobs and Tasks?
- Creating Workflows and Jobs
- Running and Monitoring Jobs
- Configuring the Job Manager
- TaskManager: Asynchronous Scheduling of Tasks
- Worker Reference
- Bulkbuilder worker
- PipelineProcesor Worker
- PipeletProcessor Worker
- See Importing below for more workers
- Developing new Workers
Importing
- Concepts, Workflow and Components
- Reference of Import Workers
- Developing new Import Workers
- Additionally
Embedded HTTP Server
Common Services
- Configuration Helper
- Workspace Helper
- ClusterConfig Service
- Zookeeper Service
- ObjectStore
- BinaryStorage
- Processing Security Information
- Ontology Processing with Sesame: Configuration and Pipelets
- MimeTypeIdentifier
- Description of Worker and Pipelet Parameters
- Publishing Web Services
- General JPA Configuration in SMILA
- SMILA Version Information