org.crosswire.jsword.index.lucene.analysis
Class SmartChineseLuceneAnalyzer

java.lang.Object
  org.apache.lucene.analysis.Analyzer
      org.crosswire.jsword.index.lucene.analysis.AbstractBookAnalyzer
          org.crosswire.jsword.index.lucene.analysis.SmartChineseLuceneAnalyzer

All Implemented Interfaces:

Closeable

public class SmartChineseLuceneAnalyzer
extends AbstractBookAnalyzer

A simple wrapper for SmartChineseAnalyzer, which takes overlapping two character tokenization approach which leads to larger index size, like org.apache.lucene.analyzer.cjk.CJKAnalyzer. This analyzer's stop list is merely of punctuation. It does stemming of English.

Author:

DM Smith

See Also:

The GNU Lesser General Public License for details.

Field Summary

private org.apache.lucene.analysis.cn.smart.SmartChineseAnalyzer

myAnalyzer

Fields inherited from class org.crosswire.jsword.index.lucene.analysis.AbstractBookAnalyzer

book, doStemming, doStopWords, stopSet

Fields inherited from class org.apache.lucene.analysis.Analyzer

overridesTokenStreamMethod

Constructor Summary

SmartChineseLuceneAnalyzer()

Method Summary

org.apache.lucene.analysis.TokenStream	reusableTokenStream(String fieldName, Reader reader)
org.apache.lucene.analysis.TokenStream	tokenStream(String fieldName, Reader reader)

Methods inherited from class org.crosswire.jsword.index.lucene.analysis.AbstractBookAnalyzer

getBook, getDoStopWords, setBook, setDoStemming, setDoStopWords, setStopWords

Methods inherited from class org.apache.lucene.analysis.Analyzer

close, getOffsetGap, getPositionIncrementGap, getPreviousTokenStream, setOverridesTokenStreamMethod, setPreviousTokenStream

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

myAnalyzer

private org.apache.lucene.analysis.cn.smart.SmartChineseAnalyzer myAnalyzer

Constructor Detail

SmartChineseLuceneAnalyzer

public SmartChineseLuceneAnalyzer()

Method Detail

tokenStream

public final org.apache.lucene.analysis.TokenStream tokenStream(String fieldName,
                                                                Reader reader)

Specified by:

tokenStream in class org.apache.lucene.analysis.Analyzer

reusableTokenStream

public final org.apache.lucene.analysis.TokenStream reusableTokenStream(String fieldName,
                                                                        Reader reader)
                                                                 throws IOException

Overrides:

reusableTokenStream in class org.apache.lucene.analysis.Analyzer

Throws:

IOException