Class: Ferret::Analysis::LowerCaseTokenizer

Inherits:

LetterTokenizer

• Object
• TokenStream
• Tokenizer
• RegExpTokenizer
• LetterTokenizer
• Ferret::Analysis::LowerCaseTokenizer

Defined in:

lib/ferret/analysis/tokenizers.rb

Overview

LowerCaseTokenizer performs the function of LetterTokenizer and LowerCaseFilter together. It divides text at non-letters and converts them to lower case.

Method Summary

Methods inherited from RegExpTokenizer

#close, #initialize, #next

Methods inherited from Tokenizer

#close

Methods inherited from TokenStream

#close, #each, #next

Constructor Details

This class inherits a constructor from Ferret::Analysis::RegExpTokenizer