NAME
DTA::TokWrap::Processor::tokenize::auto - DTA tokenizer wrappers: auto tokenizer
SYNOPSIS
use DTA::TokWrap::Processor::tokenize::auto;
$td = DTA::TokWrap::Processor::tokenize::auto->new(%args);
$doc_or_undef = $td->tokenize($doc);
DESCRIPTION
DTA::TokWrap::Processor::tokenize::auto provides a "smart" wrapper for the low-level tokenizer class DTA::TokWrap::Processor::tokenize.
Constants
- @ISA
-
DTA::TokWrap::Processor::tokenize::auto inherits from DTA::TokWrap::Processor::tokenize.
Constructors etc.
- new
-
$td = $CLASS_OR_OBJ->new(%args);
Constructor.
%args, %$td:
tokenize => $path_to_dtatw_tokenize, ##-- default: search inplace => $bool, ##-- prefer in-place programs for search?
- defaults
-
%defaults = $CLASS->defaults();
Static class-dependent defaults.
- init
-
$td = $td->init();
Dynamic object-dependent defaults.
Methods
- tokenize
-
$doc_or_undef = $CLASS_OR_OBJECT->tokenize($doc);
SEE ALSO
DTA::TokWrap::Intro(3pm), dta-tokwrap.perl(1), ...
SEE ALSO
DTA::TokWrap::Intro(3pm), dta-tokwrap.perl(1), ...
AUTHOR
Bryan Jurish <moocow@cpan.org>
COPYRIGHT AND LICENSE
Copyright (C) 2009-2018 by Bryan Jurish
This package is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.14.2 or, at your option, any later version of Perl 5 you may have available.