SMILA/Documentation/Solr Integration

org.eclipse.smila.integration.solr.SolrPipelet

Description

This pipelet integrates Apache Solr's HTTP REST API (http://wiki.apache.org/solr/SearchHandler?action=show&redirect=StandardRequestHandler and http://wiki.apache.org/solr/UpdateXmlMessages ) for utilizing Solr as a distributed index service. Therefore it is now possible to build large volume search applications by basing them on SMILA and deploying Solr for coping with large indices which are not manageable on one node because of their large size which exceeds the limits of the node's file system.

Note: Currently this pipelet supports Solr 1.4. The integration of features added with the release of Solr 1.5 will be done in near future.

Configuration

Property	Constraint	Description
executionMode	optional	the execution mode of the pipelet, default is ADD
allowDoublets	optional	the instruction for Solr if doublets are allowed, default is false
commitWithin	optional	the commit interval for Solr in miliseconds, default is 10000
indexName	optional	the name of the index/core on which Solr should operate. Currently we do not support more than one index/core.
highlight	optional	the highlight flag, default is true
highlight.params	optional	all the highlighting parameter passed directly to Solr. For more details please see: http://wiki.apache.org/solr/HighlightingParameters

Example

PipeletConfiguration for SolrPipelet in addpipeline.bpel

<proc:PipeletConfiguration>
	<proc:Property name="executionMode">
		<proc:Value>ADD</proc:Value>
	</proc:Property>
	<proc:Property name="allowDoublets" type="java.lang.Boolean">
		<proc:Value>false</proc:Value>
	</proc:Property>
	<proc:Property name="commitWithin" type="java.lang.Integer">
		<proc:Value>10000</proc:Value>
	</proc:Property>
	<proc:Property name="indexName">
		<proc:Value>test_index</proc:Value>
	</proc:Property>
</proc:PipeletConfiguration>

PipeletConfiguration for SolrPipelet in searchpipeline.bpel

<proc:PipeletConfiguration>
	<proc:Property name="shards">
		<proc:Value>localhost:8983/solr</proc:Value>
		<!-- List here all other nodes that are part of the index cluster -->
	</proc:Property>
	<proc:Property name="highlight" type="java.lang.Boolean">
		<proc:Value>true</proc:Value>
	</proc:Property>
	<proc:Property name="highlight.params">
		<proc:Value>hl.fl=Content</proc:Value>
		<proc:Value>hl.snippets=3</proc:Value>
		<proc:Value>hl.simple.pre=&lt;b&gt;</proc:Value>
		<proc:Value>hl.simple.post=&lt;/b&gt;</proc:Value>
		<proc:Value>hl.fragsize=300</proc:Value>
		<proc:Value>hl.mergeContiguous=false</proc:Value>
	</proc:Property>
</proc:PipeletConfiguration>