|
|
| (20 intermediate revisions by 2 users not shown) |
| Line 1: |
Line 1: |
| − | == Basics ==
| + | #REDIRECT [[SMILA/Documentation]] |
| − | * [[SMILA/Architecture_Overview|Architecture]]
| + | |
| − | * [[SMILA/Documentation/Data_Model_and_Serialization_Formats|Data Model, XML, JSON, BON]]
| + | |
| − | * '''TODO''' Using the ReST API
| + | |
| − | * [[SMILA/REST_API_Reference|REST API Reference]]
| + | |
| − | | + | |
| − | == The SMILA Development Environment ==
| + | |
| − | * [[SMILA/Development_Guidelines/Howto_set_up_dev_environment|Setup your Eclipse IDE for SMILA]]
| + | |
| − | * [[SMILA/Development_Guidelines/Howto_build_a_SMILA-Distribution|Build SMILA]]
| + | |
| − | * [[SMILA/Development_Guidelines/Create_a_bundle_(plug-in)|Creating new components]]
| + | |
| − | * [[SMILA/Development_Guidelines/Create_a_test_bundle_(plug-in)|Testing new components]]
| + | |
| − | * [[SMILA/Development_Guidelines/3rd_party_bundle|Adding Third Party libraries to SMILA]]
| + | |
| − | * Extending the build process:
| + | |
| − | ** [[SMILA/Development_Guidelines/How_to_integrate_new_bundle_into_build_process|Adding a new component bundle to the build]]
| + | |
| − | ** [[SMILA/Development_Guidelines/How_to_integrate_test_bundle_into_build_process|Adding a new test bundle to the build]]
| + | |
| − | | + | |
| − | == Pipelines and Pipelets: Synchronous Workflows of Java components ==
| + | |
| − | * [[SMILA/Documentation/Pipelets|What are Pipelets?]]
| + | |
| − | * [[SMILA/Documentation/BPEL_Workflow_Processor|Configuration and Creating BPEL Pipelines]]
| + | |
| − | ** [[SMILA/Development_Guidelines/How_to_filter_and_access_record_data_in_BPEL|Accessing SMILA records in BPEL activities]]
| + | |
| − | * [[SMILA/BPEL_Designer|Using the SMILA BPEL Designer]]
| + | |
| − | * Basic Pipelets
| + | |
| − | ** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets|Common pipelets: bundle org.eclipse.smila.processing.pipelets]]
| + | |
| − | ** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets.xmlprocessing|Common XML pipelets: Bundle org.eclipse.smila.processing.pipelets.xmlprocessing]]
| + | |
| − | ** More special pipelets are provided by components described below.
| + | |
| − | * Developing Pipelets
| + | |
| − | ** [[SMILA/Development_Guidelines/How_to_write_a_Pipelet|How to write a pipelet]]
| + | |
| − | ** [[SMILA/Documentation/Usage_of_Blackboard_Service|BlackboardService]]
| + | |
| − | | + | |
| − | == Using SMILA for Search ==
| + | |
| − | | + | |
| − | * [[SMILA/Documentation/Search|Search Processing and APIs]]
| + | |
| − | * [[SMILA/Documentation/Solr|Solr Integration: Configuration and Pipelets]]
| + | |
| − | | + | |
| − | == JobManager: Asynchronous Workflows ==
| + | |
| − | * [[SMILA/Documentation/JobManager|Concepts: Jobs and Tasks]]
| + | |
| − | ** [[SMILA/Documentation/JobManagerFirstExample|A simple example]]
| + | |
| − | * Creating Workflows and Jobs
| + | |
| − | ** [[SMILA/Documentation/DataObjectTypesAndBuckets|Defining Buckets]]
| + | |
| − | ** [[SMILA/Documentation/WorkerAndWorkflows|Modeling Workflows]]
| + | |
| − | ** [[SMILA/Documentation/JobDefinitions|Creating Jobs]]
| + | |
| − | * [[SMILA/Documentation/JobRuns|Running and Monitoring Jobs]]
| + | |
| − | * [[SMILA/Documentation/JobManagerConfiguration|JobManager Configuration]]
| + | |
| − | * [[SMILA/Documentation/TaskManager|TaskManager: Asynchronous scheduling of tasks]]
| + | |
| − | * Workers Reference
| + | |
| − | ** [[SMILA/Documentation/Bulkbuilder|Bulkbuilder]]
| + | |
| − | ** [[SMILA/Documentation/Worker/PipelineProcessorWorker|PipelineProcesor]]
| + | |
| − | ** [[SMILA/Documentation/Worker/PipeletProcessorWorker|PipeletProcessor]]
| + | |
| − | ** See [[SMILA/Manual#Importing|Importing]] below for more workers
| + | |
| − | * Developing Workers
| + | |
| − | * [[SMILA/Documentation/WorkerManager|WorkerManager: Workers made easy]]
| + | |
| − | * [[SMILA/Development_Guidelines/How_to_write_a_Worker|Developing Workers]]
| + | |
| − | | + | |
| − | == Importing ==
| + | |
| − | * [[SMILA/Documentation/Importing/Concept|Concepts]]
| + | |
| − | * Importing Workers reference
| + | |
| − | **[[SMILA/Documentation/Importing/Crawler/File | FileCrawler and FileFetcher worker]]
| + | |
| − | **[[SMILA/Documentation/Importing/Crawler/Web | WebCrawler and WebFetcher worker]]
| + | |
| − | **[[SMILA/Documentation/Importing/DeltaCheck | DeltaCheck worker]]
| + | |
| − | **[[SMILA/Documentation/Importing/UpdatePusher | UpdatePusher worker]]
| + | |
| − | * Developing Importing Workers
| + | |
| − | ** [[SMILA/Documentation/Importing/VisitedLinks | VisitedLinks service]]
| + | |
| − | ** [[SMILA/Documentation/Importing/Crawler/Web#Internal_structure|Extending the WebCrawler worker]]
| + | |
| − | | + | |
| − | == The SMILA HTTP Server ==
| + | |
| − | * [[SMILA/Documentation/JettyHttpServer|Configuration of Jetty]]
| + | |
| − | * [[SMILA/Documentation/JettyHttpServer#JSON_Handlers|Developing JSON ReST handlers for SMILA]]
| + | |
| − | | + | |
| − | == Common Services ==
| + | |
| − | * Configuration Helper
| + | |
| − | * [[SMILA/Documentation/Workspace_Handling|Workspace Helper]]
| + | |
| − | * [[SMILA/Documentation/Bundle_org.eclipse.smila.clusterconfig|ClusterConfig service]]
| + | |
| − | ** [[SMILA/Documentation/Bundle_org.eclipse.smila.clusterconfig.simple|Simple implementation]]
| + | |
| − | * [[SMILA/Documentation/ObjectStore/Bundle_org.eclipse.smila.objectstore|ObjectStore]]
| + | |
| − | ** [[SMILA/Documentation/ObjectStore/Bundle_org.eclipse.smila.objectstore.filesystem|Filesystem Objectstore implementation]]
| + | |
| − | * [[SMILA/Documentation/Binary_Storage|BinaryStorage]]
| + | |
| − | * [[SMILA/Documentation/Security|Processing security information]]
| + | |
| − | ** [[SMILA/Documentation/LDAPSecurityResolver|Implementation for using LDAP]]
| + | |
| − | ** [[SMILA/Documentation/SecurityProcessingServices|Example Pipelets]]
| + | |
| − | * [[SMILA/Documentation/SesameOntologyManager|Ontology processing with Sesame: Configuration and Pipelets]]
| + | |
| − | * [[SMILA/Documentation/MimeTypeIdentifier|MimeTypeIdentifier]]
| + | |
| − | * [[SMILA/Documentation/PublishingJAXWSWebservices|Publishing Web Services]]
| + | |
| − | | + | |
| − | == Deprecated Components ==
| + | |
| − | * Connectivity Framework
| + | |
| − | **[[SMILA/Documentation/ConnectivityManager|ConnectivityManager]]
| + | |
| − | **[[SMILA/Documentation/DeltaIndexingManager|DeltaIndexingManager]]
| + | |
| − | **[[SMILA/Documentation/ConnectivityFramework|ConnectivityFramework]]
| + | |
| − | ***[[SMILA/Documentation/CrawlerController|CrawlerController]]
| + | |
| − | ***[[SMILA/Documentation/Crawler|Crawler]]
| + | |
| − | ****[[SMILA/Documentation/Filesystem Crawler|Filesystem Crawler]]
| + | |
| − | ****[[SMILA/Documentation/Web Crawler|Web Crawler]]
| + | |
| − | ****[[SMILA/Documentation/JDBC Crawler|JDBC Crawler]]
| + | |
| − | ***[[SMILA/Documentation/AgentController|AgentController ]]
| + | |
| − | ***[[SMILA/Documentation/Agent|Agent]]
| + | |
| − | ****[[SMILA/Documentation/Mock Agent|Mock Agent]]
| + | |
| − | ****[[SMILA/Documentation/Feed Agent|Feed Agent]]
| + | |
| − | ****[[SMILA/Documentation/JobFile Agent|JobFile Agent]]
| + | |
| − | ***[[SMILA/Documentation/CompoundManagement|CompoundManagement]]
| + | |
| − | ** [[SMILA/Documentation/Management|JMX Management]]
| + | |
| − | *** [[SMILA/Documentation/Management#JMX_Client|JMX Clients]]
| + | |
| − | ** [[SMILA/Documentation/Record_Storage|RecordStorage]]
| + | |
| − | | + | |
| − | [[Category:SMILA]]
| + | |
