org.crosswire.jsword.index.lucene.analysis
Class SmartChineseLuceneAnalyzer
java.lang.Object
org.apache.lucene.analysis.Analyzer
org.crosswire.jsword.index.lucene.analysis.AbstractBookAnalyzer
org.crosswire.jsword.index.lucene.analysis.SmartChineseLuceneAnalyzer
- All Implemented Interfaces:
- Closeable
public class SmartChineseLuceneAnalyzer
- extends AbstractBookAnalyzer
A simple wrapper for SmartChineseAnalyzer
, which takes overlapping
two character tokenization approach which leads to larger index size, like
org.apache.lucene.analyzer.cjk.CJKAnalyzer
. This analyzer's stop list
is merely of punctuation. It does stemming of English.
- Author:
- DM Smith
- See Also:
The GNU Lesser General Public License for details.
Field Summary |
private org.apache.lucene.analysis.cn.smart.SmartChineseAnalyzer |
myAnalyzer
|
Fields inherited from class org.apache.lucene.analysis.Analyzer |
overridesTokenStreamMethod |
Methods inherited from class org.apache.lucene.analysis.Analyzer |
close, getOffsetGap, getPositionIncrementGap, getPreviousTokenStream, setOverridesTokenStreamMethod, setPreviousTokenStream |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
myAnalyzer
private org.apache.lucene.analysis.cn.smart.SmartChineseAnalyzer myAnalyzer
SmartChineseLuceneAnalyzer
public SmartChineseLuceneAnalyzer()
tokenStream
public final org.apache.lucene.analysis.TokenStream tokenStream(String fieldName,
Reader reader)
- Specified by:
tokenStream
in class org.apache.lucene.analysis.Analyzer
reusableTokenStream
public final org.apache.lucene.analysis.TokenStream reusableTokenStream(String fieldName,
Reader reader)
throws IOException
- Overrides:
reusableTokenStream
in class org.apache.lucene.analysis.Analyzer
- Throws:
IOException