NAME
Dezi::Indexer - base indexer class
SYNOPSIS
use Dezi::Indexer;
my $indexer = Dezi::Indexer->new(
invindex => Dezi::InvIndex->new,
config => Dezi::Indexer::Config->new,
count => 0,
clobber => 1,
flush => 10000,
started => time()
);
$indexer->start;
for my $doc (@list_of_docs) {
$indexer->process($doc);
}
$indexer->finish;
DESCRIPTION
Dezi::Indexer is a base class implementing the simplest of indexing APIs. It is intended to be subclassed, along with InvIndex, for each IR backend library.
METHODS
new( params )
Constructor. See the SYNOPSIS for default options.
params may include the following keys, each of which is also an accessor method:
- clobber
-
Over-write any existing InvIndex.
- config
-
A Dezi::Indexer::Config object or file name.
- flush
-
The number of indexed docs at which in-memory changes should be written to disk.
- invindex
-
A Dezi::InvIndex object.
- test_mode
-
Dry run mode, just prints info on stderr but does not build index.
BUILD
Setup object. Called internally by new().
init_swish3
Returns a SWISH::3 object that uses swish3_handler. This builder method is called on Indexer construction if swish3 is uninitialized.
start
Opens the invindex() object and sets the started() time to time().
Subclasses should always call SUPER::start() if they override this method since it provides sanity checking on the InvIndex.
process( doc )
doc should be a Dezi::Indexer::Doc-derived object.
process() should implement whatever the particular IR library API requires. The default action calls swish3_handler on doc.
swish3_handler( swish3_payload )
This method is called on every document passed to process(). See the SWISH::3 documentation for what to expect in swish3_payload.
This is an abstract method. Subclasses must implement it.
finish
Closes the invindex().
count
Returns the number of documents processed.
started
The time at which the Indexer start() method was called. Returns a Unix epoch integer.
AUTHOR
Peter Karman, <perl@peknet.com>
BUGS
Please report any bugs or feature requests to bug-swish-prog at rt.cpan.org
, or through the web interface at http://rt.cpan.org/NoAuth/ReportBug.html?Queue=Dezi-App. I will be notified, and then you'll automatically be notified of progress on your bug as I make changes.
SUPPORT
You can find documentation for this module with the perldoc command.
perldoc Dezi
You can also look for information at:
Mailing list
RT: CPAN's request tracker
AnnoCPAN: Annotated CPAN documentation
CPAN Ratings
Search CPAN
COPYRIGHT AND LICENSE
Copyright 2008-2018 by Peter Karman
This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself.