Changes for version 0.04 - 2021-03-09

  • Always call `next` method, so it can be overridden

Modules

lexer to break text up into user-defined tokens
reusable lexer for token-stream scanning
role for token-stream classes
class to model scanned tokens
types used by Text::TokenStream et al