Class: CTokenizer::LexerBase

Inherits:

Object

• Object
• CTokenizer::LexerBase

Includes:

CTokenizer

Defined in:

lib/dbc/ctokenizer.rb

Overview

wraps a lexer and uses that to produce new tokens

Direct Known Subclasses

CLexer, CPLexer, SkipMacros, Splitter, DBC::Cache, DBC::Parser, Preprocessor::Parser

Instance Method Summary

• #empty? ⇒ Boolean
• #file ⇒ Object
• #initialize(str, file = nil, line = 1) ⇒ LexerBase constructor

  A new instance of LexerBase.

• #line ⇒ Object
• #shift ⇒ Object

Methods included from CTokenizer

check_string, check_token, #collect, create_newlines, #each, error, #error, join, line_count, #parse_error, split, split_token, #to_a, #token_error, #warning

Constructor Details

#initialize(str, file = nil, line = 1) ⇒ LexerBase

Returns a new instance of LexerBase.

# File 'lib/dbc/ctokenizer.rb', line 216

def initialize(str, file=nil, line=1)
	if (str.class <= String)
		@source = Lexer.new(str, file, line)
	else
		@source = str
	end
end

Instance Method Details

#empty? ⇒ Boolean

Returns:

• (Boolean)

# File 'lib/dbc/ctokenizer.rb', line 237

def empty?
	@source.empty?
end

#file ⇒ Object

# File 'lib/dbc/ctokenizer.rb', line 224

def file
	@source.file
end

#line ⇒ Object

# File 'lib/dbc/ctokenizer.rb', line 227

def line
	@source.line
end

#shift ⇒ Object

# File 'lib/dbc/ctokenizer.rb', line 231

def shift
	t = @source.shift
	CTokenizer.check_token(t)
	t
end