org.jahia.services.search.analyzer

Class EnglishSnowballAnalyzer

java.lang.Object

org.apache.lucene.analysis.Analyzer

org.apache.lucene.analysis.ReusableAnalyzerBase

org.apache.lucene.analysis.StopwordAnalyzerBase

org.jahia.services.search.analyzer.EnglishSnowballAnalyzer

All Implemented Interfaces:

Closeable, AutoCloseable

public class EnglishSnowballAnalyzer
extends org.apache.lucene.analysis.StopwordAnalyzerBase

Filters StandardTokenizer with StandardFilter, LowerCaseFilter, StopFilter, SnowballFilter for English and ASCIIFoldingFilter.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.lucene.analysis.ReusableAnalyzerBase

org.apache.lucene.analysis.ReusableAnalyzerBase.TokenStreamComponents

Field Summary

Fields inherited from class org.apache.lucene.analysis.StopwordAnalyzerBase

matchVersion, stopwords

Constructor Summary

Constructors

Constructor and Description
EnglishSnowballAnalyzer(org.apache.lucene.util.Version matchVersion) Builds an analyzer with the default stop words: getDefaultStopSet().
EnglishSnowballAnalyzer(org.apache.lucene.util.Version matchVersion, Set<?> stopwords) Builds an analyzer with the given stop words.
EnglishSnowballAnalyzer(org.apache.lucene.util.Version matchVersion, Set<?> stopwords, Set<?> stemExclusionSet) Builds an analyzer with the given stop words.

Method Summary

Modifier and Type	Method and Description
protected org.apache.lucene.analysis.ReusableAnalyzerBase.TokenStreamComponents	createComponents(String fieldName, Reader reader) Creates a ReusableAnalyzerBase.TokenStreamComponents which tokenizes all the text in the provided Reader.
static Set<?>	getDefaultStopSet() Returns an unmodifiable instance of the default stop words set.

Methods inherited from class org.apache.lucene.analysis.StopwordAnalyzerBase

getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet

Methods inherited from class org.apache.lucene.analysis.ReusableAnalyzerBase

initReader, reusableTokenStream, tokenStream

Methods inherited from class org.apache.lucene.analysis.Analyzer

close, getOffsetGap, getPositionIncrementGap, getPreviousTokenStream, setPreviousTokenStream

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

EnglishSnowballAnalyzer

public EnglishSnowballAnalyzer(org.apache.lucene.util.Version matchVersion)

Builds an analyzer with the default stop words: getDefaultStopSet().

EnglishSnowballAnalyzer

public EnglishSnowballAnalyzer(org.apache.lucene.util.Version matchVersion,
                               Set<?> stopwords)

Builds an analyzer with the given stop words.

Parameters:

matchVersion - lucene compatibility version

stopwords - a stopword set

EnglishSnowballAnalyzer

public EnglishSnowballAnalyzer(org.apache.lucene.util.Version matchVersion,
                               Set<?> stopwords,
                               Set<?> stemExclusionSet)

Builds an analyzer with the given stop words. If a non-empty stem exclusion set is provided this analyzer will add a KeywordMarkerFilter before stemming.

Parameters:

matchVersion - lucene compatibility version

stopwords - a stopword set

stemExclusionSet - a set of terms not to be stemmed

Method Detail

getDefaultStopSet

public static Set<?> getDefaultStopSet()

Returns an unmodifiable instance of the default stop words set.

Returns:

default stop words set.

createComponents

protected org.apache.lucene.analysis.ReusableAnalyzerBase.TokenStreamComponents createComponents(String fieldName,
                                                                                                 Reader reader)

Creates a ReusableAnalyzerBase.TokenStreamComponents which tokenizes all the text in the provided Reader.

Specified by:

createComponents in class org.apache.lucene.analysis.ReusableAnalyzerBase

Returns:

A ReusableAnalyzerBase.TokenStreamComponents built from an StandardTokenizer filtered with StandardFilter, LowerCaseFilter, StopFilter , KeywordMarkerFilter if a stem exclusion set is provided, SnowballFilter and ASCIIFoldingFilter.