Class: CSKit::Parsers::Bible::BibleTokenizer

Inherits:
Tokenizer
  • Object
show all
Defined in:
lib/cskit/parsers/bible/bible_tokenizer.rb

Constant Summary collapse

PATTERNS =
{
  book:        /\Ai{1,3}\s+[^\s\(\);:,]+/i,
  sos:         /\Asong\s+of\s+solomon/i,
  left_paren:  /\A\(/,
  right_paren: /\A\)/,
  dash:        /\A-/,
  colon:       /\A:/,
  semicolon:   /\A;/,
  comma:       /\A,/,
  to:          /\Ato/,
  cardinality: /\A(1st|2nd|3rd|4th)/,
  number:      /\A\d+/,
  text:        /\A[^\s\(\);:,]+/,
  space:       /\A[\s\t]+/
}

Instance Attribute Summary

Attributes inherited from Tokenizer

#citation

Method Summary

Methods inherited from Tokenizer

#each_token, #initialize

Constructor Details

This class inherits a constructor from CSKit::Parsers::Tokenizer