NAME
Moot::TokenReader::Native - libmoot: Token I/O: reader: native 1 word/line format
SYNOPSIS
use Moot::TokenReader::Native;
##=====================================================================
## Usage
$tr = Moot::TokenReader::Native->new($fmt); ##-- constructor
$tr->from_file($filename); ##-- open a named file
$sent = $tr->get_sentence(); ##-- read next sentence
$tr->close(); ##-- close current input source
#... or any other Moot::TokenReader methodDESCRIPTION
The Moot::TokenReader::Native module provides wrappers for native 1 word/line word- and sentence-input streams as included in the libmoot library for Hidden Markov Model decoding.
Moot::TokenReader::Native inherits from Moot::TokenReader and supports all Moot::TokenReader API methods.
File Format
FILE ::= SENTENCE*
SENTENCE ::= ((TOKEN|COMMENT)*) "\n"
TOKEN ::= TOKEN_TEXT ("\t" ANALYSIS)* ("\r"*) "\n"
TOKEN_TEXT ::= [^\\t\\r\\n]*
ANALYSIS ::= (DETAIL*) (COST?) (DETAIL*) "[" TAG ( "]" | " " ) (DETAIL*) (COST?) (DETAIL*)
DETAIL ::= [^\\t\\r\\n]
COST ::= "<" FLOAT ">"
COMMENT ::= "^%%" (.*) "\n"SEE ALSO
Moot::TokenReader::XML(3perl), Moot::TokenReader(3perl), Moot::TokenWriter(3perl), Moot::TokenIO(3perl), Moot(3perl), mootfiles(5), moot(1), perl(1).
AUTHOR
Bryan Jurish <moocow@cpan.org>
COPYRIGHT AND LICENSE
Copyright (C) 2013 by Bryan Jurish
This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.14.2 or, at your option, any later version of Perl 5 you may have available.