The London Perl and Raku Workshop takes place on 26th Oct 2024. If your company depends on Perl, please consider sponsoring and/or attending.

NAME

SECO::Index - Build Search Index

SYNOPSIS

use SECO::Index;

my $index = SECO::Index->new
(
    version => $version, dc => 'zzbc' hdfs => 'hdfs/path', repo => 'repo/path'
);

HDFS

/home/$USER/cdx/
    $version/$dbid/
        src/$ts.$id.{full,incr,rank}.$count/
        dst/$ts.$id.data.$version.$dbid/

e.g.

/home/cloudops/cdx/v0004/0038/src/2013010320220319.00232.incr.03193
/home/cloudops/cdx/v0004/0038/dst/2013010320220319.00248.data.v0004.0038

REPO

/home/$USER/ytt/
    data/ -> $ts.$id.data.$version.$dbid
        Transdata/ -> /home/$USER/ytt

e.g.

/home/search/data
=> /home/search/2013010320220319.00248.data.v0004.0038

/home/search/2013010320220319.00248.data.v0004.0038/Transdata
=> /home/search/data

FIELD

$version

CDX version, v0001 .. v9999

$count

Number of files in director, 00000 .. 99999

$ts

Timestamp, 2013010320220319

$id

Increment ID, 00001 .. 99999

$dbid

Database ID, 0001 .. 0400

METHODS

setup( $data, @path )

set up links and file list

id( $name )

get id section of $name