com.aliasi.tokenizer
Class LowerCaseFilterTokenizer

java.lang.Object
  extended by com.aliasi.tokenizer.Tokenizer
      extended by com.aliasi.tokenizer.FilterTokenizer
          extended by com.aliasi.tokenizer.TokenFilterTokenizer
              extended by com.aliasi.tokenizer.LowerCaseFilterTokenizer
All Implemented Interfaces:
Iterable<String>

Deprecated. Use LowerCaseTokenizerFactory instead.

@Deprecated
public class LowerCaseFilterTokenizer
extends TokenFilterTokenizer

A LowerCaseFilterTokenizer renders all of its tokens in lower case as defined by String.toLowerCase(). The scheme for lower-casing is determined by a Locale.

Since:
LingPipe1.0
Version:
3.8
Author:
Bob Carpenter

Field Summary
 
Fields inherited from class com.aliasi.tokenizer.FilterTokenizer
mTokenizer
 
Constructor Summary
LowerCaseFilterTokenizer(Tokenizer tokenizer)
          Deprecated. Use LowerCaseTokenizerFactory or ModifyTokenTokenizerFactory.modify(Tokenizer) instead.
LowerCaseFilterTokenizer(Tokenizer tokenizer, Locale locale)
          Deprecated. Use LowerCaseTokenizerFactory or ModifyTokenTokenizerFactory.modify(Tokenizer) instead.
 
Method Summary
 String filter(String token)
          Deprecated. Returns the next token from the contained tokenizer, converted to lower case.
 String toString()
          Deprecated. Returns the string representation of this tokenizer, including the programmatic name of its entire locale.
 
Methods inherited from class com.aliasi.tokenizer.TokenFilterTokenizer
nextToken
 
Methods inherited from class com.aliasi.tokenizer.FilterTokenizer
baseTokenizer, lastTokenEndPosition, lastTokenStartPosition, nextWhitespace, setTokenizer
 
Methods inherited from class com.aliasi.tokenizer.Tokenizer
iterator, tokenize, tokenize
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
 

Constructor Detail

LowerCaseFilterTokenizer

@Deprecated
public LowerCaseFilterTokenizer(Tokenizer tokenizer)
Deprecated. Use LowerCaseTokenizerFactory or ModifyTokenTokenizerFactory.modify(Tokenizer) instead.

Construct a new lower case filter tokenizer with a default locale of Locale.ENGLISH.

Parameters:
tokenizer - Contained tokenizer.

LowerCaseFilterTokenizer

@Deprecated
public LowerCaseFilterTokenizer(Tokenizer tokenizer,
                                           Locale locale)
Deprecated. Use LowerCaseTokenizerFactory or ModifyTokenTokenizerFactory.modify(Tokenizer) instead.

Construct a lower case filter tokenizer with the specified tokenizer using the locale-specific lower-casing rules.

Parameters:
tokenizer - Contained tokenizer.
locale - Locale to use for lower-casing.
Method Detail

filter

public String filter(String token)
Deprecated. 
Returns the next token from the contained tokenizer, converted to lower case.

Specified by:
filter in class TokenFilterTokenizer
Parameters:
token - Token to convert to lower case.
Returns:
Lower-cased version of specified token.

toString

public String toString()
Deprecated. 
Returns the string representation of this tokenizer, including the programmatic name of its entire locale.

Overrides:
toString in class FilterTokenizer
Returns:
The string representation of this tokenizer.