/ 
Hadoop-IO-0.003
River stage one • 1 direct dependent • 1 total dependent
/ Hadoop::IO::RCFile::Reader::FileStreamReader

NAME

Hadoop::IO::RCFile::Reader::FileStreamReader

VERSION

version 0.003

SYNOPSIS

my $reader = Hadoop::IO::RCFile::Reader::FileStreamReader->new({
                        file => "/user/hive/warehouse/db_name.db/table_name/000000_0",
                        webhdfs_client => $webhdfs_client
                    });
my ($len_read, $content) = $reader->read($len) if $reader->has_more();

DESCRIPTION

This module creates an abstract interface to access the raw file in hdfs.

NAME

Hadoop::IO::RCFile::Reader::FileStreamReader - Read the HDFS file through the WebHDFS API

METHODS

new

The constructor. Accepts parameters in key => value format.

file

webhdfs_client

read

Try to read next $len byte from the file, accept $len as parameter. Return 2 paramter, first one is number of bytes able to read from the file, second is the content as string.Return (-1,undef) if end of file reached already.

read_byte

has_more

Return true if more bytes can be read, else return false.

AUTHORS

  • Philippe Bruhat

  • Sabbir Ahmed

  • Somesh Malviya

  • Vikentiy Fesunov

COPYRIGHT AND LICENSE

This software is copyright (c) 2023 by Booking.com.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.