org.carrot2.text.preprocessing
Class LanguageModelStemmer

java.lang.Object
  org.carrot2.text.preprocessing.LanguageModelStemmer

public final class LanguageModelStemmer
extends Object

Applies stemming to words and calculates a number of frequency statistics for stems.

This class saves the following results to the PreprocessingContext:

• PreprocessingContext.AllWords.stemIndex
• PreprocessingContext.AllStems.image
• PreprocessingContext.AllStems.mostFrequentOriginalWordIndex
• PreprocessingContext.AllStems.tf
• PreprocessingContext.AllStems.tfByDocument
• PreprocessingContext.AllWords.type is populated with ITokenizer.TF_QUERY_WORD

This class requires that Tokenizer and CaseNormalizer be invoked first.

Constructor Summary

LanguageModelStemmer()

Method Summary

void	stem(PreprocessingContext context) Performs stemming and saves the results to the context.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LanguageModelStemmer

public LanguageModelStemmer()

Method Detail

stem

public void stem(PreprocessingContext context)

Performs stemming and saves the results to the context.