Class: EBNF::LL1::Lexer::Token
- Inherits:
-
Object
- Object
- EBNF::LL1::Lexer::Token
- Defined in:
- lib/ebnf/ll1/lexer.rb
Overview
Represents a lexer token.
Instance Attribute Summary collapse
-
#lineno ⇒ Integer
readonly
The line number where the token was encountered.
-
#options ⇒ Hash
readonly
Any additional options for the token.
-
#type ⇒ Symbol
readonly
The token’s symbol type.
-
#value ⇒ String
readonly
The token’s value.
Instance Method Summary collapse
-
#===(value) ⇒ Boolean
Returns ‘true` if the given `value` matches either the type or value of this token.
-
#[](key) ⇒ Object
Returns the attribute named by ‘key`.
-
#initialize(type, value, options = {}) ⇒ Token
constructor
Initializes a new token instance.
-
#inspect ⇒ String
Returns a developer-friendly representation of this token.
-
#representation ⇒ Object
Returns type, if not nil, otherwise value.
-
#to_a ⇒ Array
Returns an array representation of this token.
-
#to_hash ⇒ Hash
Returns a hash table representation of this token.
-
#to_s ⇒ Object
Readable version of token.
Constructor Details
#initialize(type, value, options = {}) ⇒ Token
Initializes a new token instance.
402 403 404 405 406 407 |
# File 'lib/ebnf/ll1/lexer.rb', line 402 def initialize(type, value, = {}) @type = type.to_s.to_sym if type @value = value.to_s @options = .dup @lineno = @options.delete(:lineno) end |
Instance Attribute Details
#lineno ⇒ Integer (readonly)
The line number where the token was encountered.
387 388 389 |
# File 'lib/ebnf/ll1/lexer.rb', line 387 def lineno @lineno end |
#options ⇒ Hash (readonly)
Any additional options for the token.
393 394 395 |
# File 'lib/ebnf/ll1/lexer.rb', line 393 def @options end |
#type ⇒ Symbol (readonly)
The token’s symbol type.
375 376 377 |
# File 'lib/ebnf/ll1/lexer.rb', line 375 def type @type end |
#value ⇒ String (readonly)
The token’s value.
381 382 383 |
# File 'lib/ebnf/ll1/lexer.rb', line 381 def value @value end |
Instance Method Details
#===(value) ⇒ Boolean
Returns ‘true` if the given `value` matches either the type or value of this token.
435 436 437 438 439 440 441 442 443 |
# File 'lib/ebnf/ll1/lexer.rb', line 435 def ===(value) case value when Symbol value == @type when ::String @value == (@options[:case_insensitive] ? value.to_s.downcase : value.to_s) else value == @value end end |
#[](key) ⇒ Object
Returns the attribute named by ‘key`.
414 415 416 417 418 419 420 421 |
# File 'lib/ebnf/ll1/lexer.rb', line 414 def [](key) key = key.to_s.to_sym unless key.is_a?(Integer) || key.is_a?(Symbol) case key when 0, :type then @type when 1, :value then @value else nil end end |
#inspect ⇒ String
Returns a developer-friendly representation of this token.
477 478 479 |
# File 'lib/ebnf/ll1/lexer.rb', line 477 def inspect to_hash.inspect end |
#representation ⇒ Object
Returns type, if not nil, otherwise value
461 462 463 |
# File 'lib/ebnf/ll1/lexer.rb', line 461 def representation @type ? @type : @value end |
#to_a ⇒ Array
Returns an array representation of this token.
469 470 471 |
# File 'lib/ebnf/ll1/lexer.rb', line 469 def to_a [@type, @value] end |
#to_hash ⇒ Hash
Returns a hash table representation of this token.
449 450 451 |
# File 'lib/ebnf/ll1/lexer.rb', line 449 def to_hash {:type => @type, :value => @value} end |
#to_s ⇒ Object
Readable version of token
455 456 457 |
# File 'lib/ebnf/ll1/lexer.rb', line 455 def to_s @type ? @type.inspect : @value end |