NAME
Datahub::Factory::Importer::OAI - Import data from an OAI-PMH endpoint
SYNOPSIS
use Datahub::Factory;
use Data::Dumper qw(Dumper);
my $oai = Datahub::Factory->importer('OAI')->new(
url => 'https://biblio.ugent.be/oai',
metadataPrefix => 'oai_dc',
set => '2011'
);
$oai->importer->each(sub {
my $item = shift;
print Dumper($item);
});
DESCRIPTION
Datahub::Factory::Importer::OAI imports data from an OAI-PMH endpoint. By default it uses the ListRecords
verb to return all records using the oai_lido format. It is possible to only return records from a single Set or those created, modified or deleted between two dates (from and until).
It automatically deals with resumptionTokens, so client code does not have to implement paging.
PARAMETERS
Only the endpoint
parameter is required.
endpoint
-
URL of the OAI endpoint.
- handler( sub {} | $object | 'NAME' | '+NAME' ) Handler to transform each record from XML DOM (XML::LibXML::Element) into Perl hash.
-
Handlers can be provided as function reference, an instance of a Perl package that implements 'parse', or by a package NAME. Package names should be prepended by
+
or prefixed withCatmandu::Importer::OAI::Parser
. E.gfoobar
will create aCatmandu::Importer::OAI::Parser::foobar
instance. By default the handler Catmandu::Importer::OAI::Parser::oai_dc is used for metadataPrefixoai_dc
, Catmandu::Importer::OAI::Parser::marcxml formarcxml
, Catmandu::Importer::OAI::Parser::mods formods
, Catmandu::Importer::OAI::Parser::Lido forLido
and Catmandu::Importer::OAI::Parser::struct for other formats. In addition there is Catmandu::Importer::OAI::Parser::raw to return the XML as it is. metadata_prefix
-
Any metadata prefix the endpoint supports. Defaults to
oai_lido
. set
-
Optionally, a set to get records from.
from
-
Optionally, a must_be_older_than date.
until
-
Optionally, a must_be_younger_than date.
username
-
An optional username.
password
-
An optional password.
ATTRIBUTES
importer
-
A Importer that can be used in your script.
AUTHOR
Pieter De Praetere <pieter at packed.be >
COPYRIGHT
Copyright 2017- PACKED vzw
LICENSE
This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself.