Difference between revisions of "SMILA/Documentation/Solr Integration"

Revision as of 08:17, 20 July 2011

Depricated:

The implementation provided by this bundle has been superseded by org.eclipse.smila.solr which is described here: SMILA/Documentation/Solr.

In future releases this bundle will be dropped.

org.eclipse.smila.integration.solr.SolrIndexPipelet

Description

This pipelet integrates Apache Solr's HTTP REST API (http://wiki.apache.org/solr/SearchHandler?action=show&redirect=StandardRequestHandler and http://wiki.apache.org/solr/UpdateXmlMessages ) for adding records to resp. deleting records from a Solr index. Therefore, it is now possible to build large volume search applications by basing them on SMILA and deploying Solr for coping with large indices which are not manageable on one node because of their large size which exceeds the limits of the node's file system.

Note: Currently this pipelet supports Solr 1.4. The integration of features added with the release of Solr 1.5 will be accomplished in the near future.

Configuration

Example

Pipelet configuration for SolrIndexPipelet in addpipeline.bpel

<extensionActivity>
  <proc:invokePipelet name="invokeSolrPipelet">
    <proc:pipelet class="org.eclipse.smila.integration.solr.SolrIndexPipelet" />
    <proc:variables input="request" />
    <proc:configuration>
      <rec:Val key="executionMode">ADD</rec:Val>
      <rec:Val key="allowDoublets" type="boolean">false</rec:Val>
      <rec:Val key="commitWithin" type="long">10000</rec:Val>
      <rec:Val key="indexname">test_index</rec:Val>
    </proc:configuration>
  </proc:invokePipelet>
</extensionActivity>

org.eclipse.smila.integration.solr.SolrSearchPipelet

Description

This pipelet integrates Apache Solr's HTTP REST API (http://wiki.apache.org/solr/SearchHandler?action=show&redirect=StandardRequestHandler and http://wiki.apache.org/solr/UpdateXmlMessages ) for searching in a Solr index.

Note: Currently this pipelet supports Solr 1.4. The integration of features added with the release of Solr 1.5 will be accomplished in the near future.

Configuration

From the search request, the pipelet uses the standard search parameters query, maxcount, offset, and resultAttributes. In addition to that, the following properties can be set in the pipelet configuration:

Example

Pipelet configuration for SolrSearchPipelet in searchpipeline.bpel

<extensionActivity>
  <proc:invokePipelet name="invokeSolrPipelet">
    <proc:pipelet class="org.eclipse.smila.integration.solr.SolrSearchPipelet" />
    <proc:variables input="request" />
    <proc:configuration>
      <rec:Seq key="shards">
        <rec:Val>localhost:8983/solr</rec:Val>
      </rec:Seq>
      <rec:Val key="highlight" type="boolean">true</rec:Val>
      <rec:Seq key="highlight.params">
        <rec:Val>hl.fl=Content</rec:Val>
        <rec:Val>hl.snippets=3</rec:Val>
        <rec:Val>hl.simple.pre=&lt;b&gt;</rec:Val>
        <rec:Val>hl.simple.post=&lt;/b&gt;</rec:Val>
        <rec:Val>hl.fragsize=300</rec:Val>
        <rec:Val>hl.mergeContiguous=false</rec:Val>
      </rec:Seq>
    </proc:configuration>
  </proc:invokePipelet>
</extensionActivity>