NAME

Moot::Waste::Scanner - libmoot : WASTE tokenizer : low-level scanner

SYNOPSIS

use Moot::Waste::Scanner;

##=====================================================================
## Usage

$ws = Moot::Waste::Scanner->new();  ##-- create a new scanner

$ws->from_file($filename);	      ##-- open a named file
$tok = $ws->get_token();            ##-- read next token
$buf = $ws->get_sentence();         ##-- read all remaining tokens as a list
$ws->close();                       ##-- close current input source

$ws->reset();                       ##-- reset scanner data

#... or (almost) any other Moot::TokenReader method

DESCRIPTION

The Moot::Waste::Scanner module provides an object-oriented interface to the WASTE tokenization system's low-level rule-based segment scanner stage. Moot::Waste::Scanner inherits from Moot::TokenReader and supports all Moot::TokenReader API methods.

SEE ALSO

Moot::TokenReader(3perl), Moot::Waste(3perl), Moot(3perl), waste(1), perl(1).

AUTHOR

Bryan Jurish <moocow@cpan.org>

COPYRIGHT AND LICENSE

Copyright (C) 2013 by Bryan Jurish

This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.14.2 or, at your option, any later version of Perl 5 you may have available.