All functions

TokenStream

An R6 class for manipulating/interrogating a stream of tokens.

create_stream()

An environment object encapsulating a stream of tokens and functions for manipulating/interrogating these token.

lex()

Break a string into labelled tokens based upon a set of patterns

re

Regexes to match common elements