Class: Dhaka::TokenizerState

Inherits:
Object
  • Object
show all
Defined in:
lib/tokenizer/tokenizer.rb

Overview

A tokenizer state encapsulates actions that should be performed upon encountering each permissible character for that state.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize ⇒ TokenizerState

Returns a new instance of TokenizerState.



24
25
26
 
# File 'lib/tokenizer/tokenizer.rb', line 24

def initialize
  @actions = {}
end

Instance Attribute Details

#actions ⇒ Object (readonly)

Returns the value of attribute actions.



22
23
24
 
# File 'lib/tokenizer/tokenizer.rb', line 22

def actions
  @actions
end

Instance Method Details

#for_characters(characters, &blk) ⇒ Object Also known as: for_character

Define the action (blk) to be performed when encountering any of characters in the token stream.



29
30
31
32
33
 
# File 'lib/tokenizer/tokenizer.rb', line 29

def for_characters(characters, &blk)
  characters.each do |character|
    actions[character] = blk
  end
end

#to_s ⇒ Object

:nodoc:



37
38
39
 
# File 'lib/tokenizer/tokenizer.rb', line 37

def to_s #:nodoc:
  actions.inspect
end