com.lucene.analysis.standard
Class StandardFilter
java.lang.Object
|
+--com.lucene.analysis.TokenStream
|
+--com.lucene.analysis.TokenFilter
|
+--com.lucene.analysis.standard.StandardFilter
- All Implemented Interfaces:
- StandardTokenizerConstants
- public final class StandardFilter
- extends TokenFilter
- implements StandardTokenizerConstants
Normalizes tokens extracted with StandardTokenizer
.
Fields inherited from interface com.lucene.analysis.standard.StandardTokenizerConstants |
ACRONYM, ALPHA, ALPHANUM, APOSTROPHE, COMPANY, DEFAULT, DIGIT, EMAIL, EOF, HAS_DIGIT, HOST, LETTER, NOISE, NUM, P, tokenImage |
Method Summary |
Token |
next()
Returns the next token in the stream, or null at EOS. |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
StandardFilter
public StandardFilter(TokenStream in)
- Construct filtering in.
next
public final Token next()
throws IOException
- Returns the next token in the stream, or null at EOS.
Removes 's from the end of words.
Removes dots from acronyms.
- Overrides:
next
in class TokenStream