NAME

DTA::CAB::Token - generic API for tokens passed to/from DTA::CAB::Analyzer

SYNOPSIS

use DTA::CAB::Token;

$tok = CLASS_OR_OBJ->new($text);

DESCRIPTION

Globals

Variable: @ISA

DTA::CAB::Token inherits from DTA::CAB::Datum.

Constructors etc.

new

$tok = CLASS_OR_OBJ->new($text);
$tok = CLASS_OR_OBJ->new($text,%args)
$tok = CLASS_OR_OBJ->new(%args)

Constructor.

%args, %$tok:

##-- Required Attributes
text => $raw_text,      ##-- raw token text
##
##-- Post-Analysis Attributes (?)
#xlit  => $a_xlit,     ##-- analysis output by DTA::CAB::Analyzer::Transliterator
#morph => $a_morph,    ##-- analysis output by DTA::CAB::Analyzer::Morph subclass for literal morphology lookup
#safe  => $a_safe,     ##-- analysis output by DTA::CAB::Analyzer::MorphSafe (?)
#rw    => $a_rw,       ##-- analysis output by DTA::CAB::Analyzer::Rewrite subclass for rewrite lookup
#...                   ##-- (maybe more)

AUTHOR

Bryan Jurish <moocow@cpan.org>

COPYRIGHT AND LICENSE

Copyright (C) 2009-2019 by Bryan Jurish

This package is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.24.1 or, at your option, any later version of Perl 5 you may have available.