NAME
Lingua::JA::Categorize::Tokenizer - extract featured words from a document
SYNOPSIS
use Lingua::JA::Categorize::Tokenizer;
my $tokenizer = Lingua::JA::Categorize::Tokenizer->new;
my $word_set = $tokenizer->tokenize($text_ref);DESCRIPTION
Lingua::JA::Categorize::Tokenizer is a featured word extractor.
It is just a warpper of Lingua::JA::TFIDF.
METHODS
new
tokenize
calc
AUTHOR
takeshi miki <miki@cpan.org>
LICENSE
This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself.