Class: EBNF::LL1::Lexer::Token
- Inherits:
-
Object
- Object
- EBNF::LL1::Lexer::Token
- Defined in:
- lib/ebnf/ll1/lexer.rb
Overview
Represents a lexer token.
Instance Attribute Summary collapse
-
#lineno ⇒ Integer
readonly
The line number where the token was encountered.
-
#options ⇒ Hash
readonly
Any additional options for the token.
-
#type ⇒ Symbol
readonly
The token’s symbol type.
-
#value ⇒ String
readonly
The token’s value.
Instance Method Summary collapse
-
#===(value) ⇒ Boolean
Returns ‘true` if the given `value` matches either the type or value of this token.
-
#[](key) ⇒ Object
Returns the attribute named by ‘key`.
-
#initialize(type, value, options = {}) ⇒ Token
constructor
Initializes a new token instance.
-
#inspect ⇒ String
Returns a developer-friendly representation of this token.
-
#representation ⇒ Object
Returns type, if not nil, otherwise value.
-
#to_a ⇒ Array
Returns an array representation of this token.
-
#to_hash ⇒ Hash
Returns a hash table representation of this token.
-
#to_s ⇒ Object
Readable version of token.
Constructor Details
#initialize(type, value, options = {}) ⇒ Token
Initializes a new token instance.
401 402 403 404 405 406 |
# File 'lib/ebnf/ll1/lexer.rb', line 401 def initialize(type, value, = {}) @type = type.to_s.to_sym if type @value = value.to_s @options = .dup @lineno = @options.delete(:lineno) end |
Instance Attribute Details
#lineno ⇒ Integer (readonly)
The line number where the token was encountered.
386 387 388 |
# File 'lib/ebnf/ll1/lexer.rb', line 386 def lineno @lineno end |
#options ⇒ Hash (readonly)
Any additional options for the token.
392 393 394 |
# File 'lib/ebnf/ll1/lexer.rb', line 392 def @options end |
#type ⇒ Symbol (readonly)
The token’s symbol type.
374 375 376 |
# File 'lib/ebnf/ll1/lexer.rb', line 374 def type @type end |
#value ⇒ String (readonly)
The token’s value.
380 381 382 |
# File 'lib/ebnf/ll1/lexer.rb', line 380 def value @value end |
Instance Method Details
#===(value) ⇒ Boolean
Returns ‘true` if the given `value` matches either the type or value of this token.
434 435 436 437 438 439 440 441 442 |
# File 'lib/ebnf/ll1/lexer.rb', line 434 def ===(value) case value when Symbol value == @type when ::String @value == (@options[:case_insensitive] ? value.to_s.downcase : value.to_s) else value == @value end end |
#[](key) ⇒ Object
Returns the attribute named by ‘key`.
413 414 415 416 417 418 419 420 |
# File 'lib/ebnf/ll1/lexer.rb', line 413 def [](key) key = key.to_s.to_sym unless key.is_a?(Integer) || key.is_a?(Symbol) case key when 0, :type then @type when 1, :value then @value else nil end end |
#inspect ⇒ String
Returns a developer-friendly representation of this token.
476 477 478 |
# File 'lib/ebnf/ll1/lexer.rb', line 476 def inspect "#{@value.inspect}#{'(' + @type.to_s + ')' if @type}" end |
#representation ⇒ Object
Returns type, if not nil, otherwise value
460 461 462 |
# File 'lib/ebnf/ll1/lexer.rb', line 460 def representation @type ? @type : @value end |
#to_a ⇒ Array
Returns an array representation of this token.
468 469 470 |
# File 'lib/ebnf/ll1/lexer.rb', line 468 def to_a [@type, @value] end |
#to_hash ⇒ Hash
Returns a hash table representation of this token.
448 449 450 |
# File 'lib/ebnf/ll1/lexer.rb', line 448 def to_hash {type: @type, value: @value} end |
#to_s ⇒ Object
Readable version of token
454 455 456 |
# File 'lib/ebnf/ll1/lexer.rb', line 454 def to_s @type ? @type.inspect : @value end |