Class: LXL::Lexer

Inherits:

Object

• Object
• LXL::Lexer

Defined in:

lib/lxl.rb

Overview

Based on John Carter’s LittleLexer (littlelexer.rubyforge.org).

Defined Under Namespace

Classes: LexerJammed

Instance Method Summary

• #initialize(re_to_chr) ⇒ Lexer constructor

  A new instance of Lexer.

• #scan(string) ⇒ Object

Constructor Details

#initialize(re_to_chr) ⇒ Lexer

Returns a new instance of Lexer.

# File 'lib/lxl.rb', line 597

def initialize(re_to_chr)
  @re_to_chr = re_to_chr
end

Instance Method Details

#scan(string) ⇒ Object

# File 'lib/lxl.rb', line 601

def scan(string)
  types,tokens = [],[]
  next_token(string) do |type,token|
    types << type
    tokens << token
  end
  [types,tokens]
end