org.crosswire.jsword.index.lucene.analysis
Class SmartChineseLuceneAnalyzer

java.lang.Object
  extended by org.apache.lucene.analysis.Analyzer
      extended by org.crosswire.jsword.index.lucene.analysis.AbstractBookAnalyzer
          extended by org.crosswire.jsword.index.lucene.analysis.SmartChineseLuceneAnalyzer
All Implemented Interfaces:
Closeable

public class SmartChineseLuceneAnalyzer
extends AbstractBookAnalyzer

A simple wrapper for SmartChineseAnalyzer, which takes overlapping two character tokenization approach which leads to larger index size, like org.apache.lucene.analyzer.cjk.CJKAnalyzer. This analyzer's stop list is merely of punctuation. It does stemming of English.

Author:
DM Smith
See Also:
for license details.
The copyright to this program is held by it's authors.

Field Summary
private  org.apache.lucene.analysis.cn.smart.SmartChineseAnalyzer myAnalyzer
           
 
Fields inherited from class org.crosswire.jsword.index.lucene.analysis.AbstractBookAnalyzer
book, doStemming, doStopWords, stopSet
 
Fields inherited from class org.apache.lucene.analysis.Analyzer
overridesTokenStreamMethod
 
Constructor Summary
SmartChineseLuceneAnalyzer()
           
 
Method Summary
 org.apache.lucene.analysis.TokenStream reusableTokenStream(String fieldName, Reader reader)
           
 org.apache.lucene.analysis.TokenStream tokenStream(String fieldName, Reader reader)
           
 
Methods inherited from class org.crosswire.jsword.index.lucene.analysis.AbstractBookAnalyzer
getBook, getDoStopWords, setBook, setDoStemming, setDoStopWords, setStopWords
 
Methods inherited from class org.apache.lucene.analysis.Analyzer
close, getOffsetGap, getPositionIncrementGap, getPreviousTokenStream, setOverridesTokenStreamMethod, setPreviousTokenStream
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

myAnalyzer

private org.apache.lucene.analysis.cn.smart.SmartChineseAnalyzer myAnalyzer
Constructor Detail

SmartChineseLuceneAnalyzer

public SmartChineseLuceneAnalyzer()
Method Detail

tokenStream

public final org.apache.lucene.analysis.TokenStream tokenStream(String fieldName,
                                                                Reader reader)
Specified by:
tokenStream in class org.apache.lucene.analysis.Analyzer

reusableTokenStream

public final org.apache.lucene.analysis.TokenStream reusableTokenStream(String fieldName,
                                                                        Reader reader)
                                                                 throws IOException
Overrides:
reusableTokenStream in class org.apache.lucene.analysis.Analyzer
Throws:
IOException

Copyright ? 2003-2011