NAME

DTA::CAB::Format::TT - Datum parser: one-token-per-line text

SYNOPSIS

use DTA::CAB::Format::TT;

##========================================================================
## Constructors etc.

$fmt = DTA::CAB::Format::TT->new(%args);

##========================================================================
## Methods: Input

$fmt = $fmt->close();
$fmt = $fmt->fromString($string);
$doc = $fmt->parseDocument();

##========================================================================
## Methods: Output

$fmt = $fmt->flush();
$str = $fmt->toString();
$fmt = $fmt->putToken($tok);
$fmt = $fmt->putSentence($sent);
$fmt = $fmt->putDocument($doc);

DESCRIPTION

Globals

Variable: @ISA

DTA::CAB::Format::TT inherits from DTA::CAB::Format.

Filenames

DTA::CAB::Format::TT registers the filename regex:

/\.(?i:t|tt|ttt)$/

with DTA::CAB::Format.

Constructors etc.

new

$fmt = CLASS_OR_OBJ->new(%args);

%args, %$fmt:

##-- Input
doc => $doc,                    ##-- buffered input document
##
##-- Output
outbuf    => $stringBuffer,     ##-- buffered output
#level    => $formatLevel,      ##-- n/a
##
##-- Common
encoding => $inputEncoding,     ##-- default: UTF-8, where applicable

Methods: Persistence

noSaveKeys

@keys = $class_or_obj->noSaveKeys();

Returns list of keys not to be saved. This implementation returns qw(doc outbuf).

Methods: Input

close

$fmt = $fmt->close();

Override: close current input source, if any.

fromString

$fmt = $fmt->fromString($string);

Override: select input from string $string.

parseTTString

$fmt = $fmt->parseTTString($str)

Guts for fromString(): parse string $str into local document buffer $fmt->{doc}.

parseDocument

$doc = $fmt->parseDocument();

Override: just returns local document buffer $fmt->{doc}.

Methods: Output

flush

$fmt = $fmt->flush();

Override: flush accumulated output

toString

$str = $fmt->toString();
$str = $fmt->toString($formatLevel)

Override: flush buffered output document to byte-string. Just encodes string in $fmt->{outbuf}.

putToken

$fmt = $fmt->putToken($tok);

Override: token output.

putSentence

$fmt = $fmt->putSentence($sent);

Override: sentence output.

putDocument

$fmt = $fmt->putDocument($doc);

Override: document output.

EXAMPLE

An example file in the format accepted/generated by this module (with very long lines) is:

%% $s:lang=de
wie	[exlex] wie	[errid] ec	[lang] de	[xlit] l1=1 lx=1 l1s=wie	[hasmorph] 1	[morph/safe] 1	[moot/word] wie	[moot/tag] PWAV	[moot/lemma] wie
oede	[xlit] l1=1 lx=1 l1s=oede	[morph/safe] 0	[moot/word] öde	[moot/tag] ADJD	[moot/lemma] öde
!	[exlex] !	[errid] ec	[xlit] l1=1 lx=1 l1s=!	[morph/safe] 1	[moot/word] !	[moot/tag] $.	[moot/lemma] !

AUTHOR

Bryan Jurish <moocow@cpan.org>

COPYRIGHT AND LICENSE

Copyright (C) 2009-2019 by Bryan Jurish

This package is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.24.1 or, at your option, any later version of Perl 5 you may have available.