Module: Dendroid::Lexical

Defined in:

lib/dendroid/lexical/token.rb,
lib/dendroid/lexical/literal.rb,
lib/dendroid/lexical/token_position.rb

Overview

This module contains the core classes needed for lexical analysis. The lexical analysis (tokenization) aims to transform the input stream of characters into a sequence of tokens.

Defined Under Namespace

Classes: Literal, Token, TokenPosition