NAME
ZMQ::LibZMQ3 - A libzmq 3.x wrapper for Perl
SYNOPSIS
use ZMQ::LibZMQ3;
use ZMQ::Constants; # separate module
my $ctxt = zmq_init($threads);
my $rv = zmq_term($ctxt);
my $msg = zmq_msg_init();
my $msg = zmq_msg_init_size( $size );
my $msg = zmq_msg_init_data( $data );
my $rv = zmq_msg_close( $msg );
my $rv = zmq_msg_move( $dest, $src );
my $rv = zmq_msg_copy( $dest, $src );
my $data = zmq_msg_data( $msg );
my $size = zmq_msg_size( $msg);
my $sock = zmq_socket( $ctxt, $type );
my $rv = zmq_close( $sock );
my $rv = zmq_setsockopt( $socket, $option, $value );
my $val = zmq_getsockopt( $socket, $option );
my $rv = zmq_bind( $sock, $addr );
my $rv = zmq_send( $sock, $buffer, $length, $flags );
my $msg = zmq_sendmsg( $sock, $msg, $flags );
my $rv = zmq_recv( $sock, $buffer, $length, $flags );
my $msg = zmq_recvmsg( $sock, $flags );
INSTALLATION
If you have libzmq registered with pkg-config:
perl Makefile.PL
make
make test
make install
If you don't have pkg-config, and libzmq is installed under /usr/local/libzmq:
ZMQ_HOME=/usr/local/libzmq \
perl Makefile.PL
make
make test
make install
If you want to customize include directories and such:
ZMQ_INCLUDES=/path/to/libzmq/include \
ZMQ_LIBS=/path/to/libzmq/lib \
ZMQ_H=/path/to/libzmq/include/zmq.h \
perl Makefile.PL
make
make test
make install
If you want to compile with debugging on:
perl Makefile.PL -g
DESCRIPTION
The ZMQ::LibZMQ3
module is a wrapper of the 0MQ message passing library for Perl.
Before you start using this module, please make sure you have read and understood the zguide.
http://zguide.zeromq.org/page:all
For specifics on each function, please refer to their documentation for the definitive explanation of each.
http://api.zeromq.org/
This module is merely a thin wrapper around the C API: You need to understand how the C API works in order to properly use this module.
Note that this is a wrapper for libzmq 3.x. For 2.x, you need to check ZMQ::LibZMQ2
BASIC USAGE
Please make sure you already have ZMQ::Constants module. If you installed ZMQ::LibZMQ3 from CPAN via cpan/cpanm, it should have already been installed for you. All socket types and other flags are declared in this module.
To start using ZMQ::LibZMQ3, you need to create a context object, then as many ZMQ::LibZMQ3::Socket obects as you need:
my $ctxt = zmq_init;
my $socket = zmq_socket( $ctxt, ... options );
You need to call zmq_bind()
or zmq_connect()
on the socket, depending on your usage. For example on a typical server-client model you would write on the server side:
zmq_bind( $socket, "tcp://127.0.0.1:9999" );
and on the client side:
zmq_connect( $socket, "tcp://127.0.0.1:9999" );
The underlying zeromq library offers TCP, multicast, in-process, and ipc connection patterns. Read the zeromq manual for more details on other ways to setup the socket.
When sending data, you can either pass a ZMQ::LibZMQ3::Message object or a Perl string.
# the following two send() calls are equivalent
my $msg = zmq_msg_init_data( "a simple message" );
zmq_sendmsg( $socket, $msg );
zmq_sendmsg( $socket, "a simple message" );
In most cases using ZMQ::LibZMQ3::Message is redundunt, so you will most likely use the string version.
To receive, simply call zmq_recvmsg()
on the socket
my $msg = zmq_recvmsg( $socket );
The received message is an instance of ZMQ::LibZMQ3::Message object, and you can access the content held in the message via the zmq_msg_data()
method:
my $data = zmq_msg_data( $msg );
WHEN IN DOUBT
0MQ is a relatively large framework, and to use it you need to be comfortable with a lot of concepts. If you think this module is not behaving like you expect it to, please read the documents for the C API
ASYNCHRONOUS I/O WITH ZEROMQ
By default 0MQ comes with its own zmq_poll() mechanism that can handle non-blocking sockets. You can use this by calling zmq_poll with a list of hashrefs:
zmq_poll([
{
fd => fileno(STDOUT),
events => ZMQ_POLLOUT,
callback => \&callback,
},
{
socket => $zmq_socket,
events => ZMQ_POLLIN,
callback => \&callback
},
], $timeout );
Unfortunately this custom polling scheme doesn't play too well with AnyEvent.
Fortunately you can use getsockopt to retrieve the underlying file descriptor, so use that to integrate ZMQ::LibZMQ3 and AnyEvent:
my $socket = zmq_socket( $ctxt, ZMQ_REP );
my $fh = zmq_getsockopt( $socket, ZMQ_FD );
my $w; $w = AE::io $fh, 0, sub {
while ( my $msg = zmq_recv( $socket, ZMQ_RCVMORE ) ) {
# do something with $msg;
}
undef $w;
};
NOTES ON MULTI-PROCESS and MULTI-THREADED USAGE
0MQ works on both multi-process and multi-threaded use cases, but you need to be careful bout sharing ZMQ::LibZMQ3 objects.
For multi-process environments, you should not be sharing the context object. Create separate contexts for each process, and therefore you shouldn't be sharing the socket objects either.
For multi-thread environemnts, you can share the same context object. However you cannot share sockets. Note that while the Perl Socket objects survive between threads, their underlying C structures do not, and you will get an error if you try to use them between sockets.
FUNCTIONS
ZMQ::LibZMQ3 attempts to stick to the libzmq interface as much as possible. Unless there is a structural problem (say, an underlying poitner that the Perl binding expects was missing), no function should throw an exception.
Return values should resemble that of libzmq, except for when new data is allocated and returned to the user - That includes things like zmq_init()
, zmq_socket()
, zmq_msg_data()
, etc.
Where applicable, $! should be updated to match the value set by libzmq, so you should be able to do:
my $cxt = zmq_init();
if (! $cxt) {
die "zmq_init() failed with $!";
}
$errno = zmq_errno()
Returns the value of errno variable for the calling thread. You normally should not need to use this function. See the man page for zmq_errno() provided by libzmq.
$string = zmq_strerror( $errno )
Returns the string representation of $errno
. Use this to stringify errors that libzmq provides.
$cxt = zmq_init( $threads )
Creates a new context object. $threads
argument is optional. Context objects can be reused across threads.
Returns undef upon error, and sets $!.
Note: Deprecated in libzmq, but the Perl binding will silently fallback to using zmq_ctx_new()
, if available.
$cxt = zmq_ctx_new( $threads );
Creates a new context object. $threads
argument is optional. Context objects can be reused across threads.
Returns undef upon error, and sets $!.
Note: may not be available depending on your libzmq version.
$rv = zmq_ctx_get( $cxt, $option )
Gets the value for the given option.
Returns -1 status upon failure, and sets $!
Note: may not be available depending on your libzmq version.
$rv = zmq_ctx_set( $cxt, $option, $value )
Sets the value for the given option.
Returns a non-zero status upon failure, and sets $!.
Note: may not be available depending on your libzmq version.
$rv = zmq_term( $cxt )
Terminates the context. Be careful, as it might hang if you have pending socket operations.
Returns a non-zero status upon failure, and sets $!.
Note: Deprecated in libzmq, but the Perl binding will silently fallback to using zmq_ctx_destroy()
, if available.
$rv = zmq_ctx_destroy( $cxt )
Terminates the context. Be careful, as it might hang if you have pending socket operations.
Returns a non-zero status upon failure, and sets $!.
Note: may not be available depending on your libzmq version.
$socket = zmq_socket( $cxt, $socket_type )
Creates a new socket object. $socket_types
are constants declared in ZMQ::Constants. Sockets cannot be reused across threads.
Returns undef upon error, and sets $!.
$rv = zmq_bind( $sock, $address )
Binds the socket to listen to specified $address
.
Returns a non-zero status upon failure, and sets $!
$rv = zmq_unbind( $sock, $address )
Stops listening on this endpoint.
Returns a non-zero status upon failure, and sets $!
Note: may not be available depending on your libzmq version.
$rv = zmq_connect( $sock, $address )
Connects the socket to specified $address
.
Returns a non-zero status upon failure, and sets $!
$rv = zmq_close( $sock )
Closes the socket explicitly.
Returns a non-zero status upon failure, and sets $!.
$value = zmq_getsockopt( $socket, $option )
Gets the value of the specified option.
If the particular version of ZMQ::LibZMQ3 does not implement the named socket option, an exception will be thrown:
/* barfs, because we don't know what type this new option is */
zmq_getsockopt( $socket, ZMQ_NEW_SHINY_OPTION );
In this case you can either use ZMQ::Constants, or you can use one of the utility functions that ZMQ::LibZMQ3 provides.
- Using ZMQ::Constants
-
ZMQ::LibZMQ3 internally refers to ZMQ::Constants to learn about the type of a socket option. You can easily add new constants to this map:
use ZMQ::Constants; ZMQ::Constants::add_sockopt_type( "int" => ZMQ_NEW_SHINY_OPTION ); # Then elsewhere... my $value = zmq_getsockopt( $socket, ZMQ_NEW_SHINY_OPTION );
- Using utilities in ZMQ::LibZMQ3
-
/* say you know that the value is an int, int64, uint64, or char * by reading the zmq docs */ $int = zmq_getsockopt_int( $socket, ZMQ_NEW_SHINY_OPTION ); $int64 = zmq_getsockopt_int64( $socket, ZMQ_NEW_SHINY_OPTION ); $uint64 = zmq_getsockopt_uint64( $socket, ZMQ_NEW_SHINY_OPTION ); $string = zmq_getsockopt_string( $socket, ZMQ_NEW_SHINY_OPTION );
$status = zmq_setsockopt( $socket, $option, $value )
Sets the value of the specified option. Returns the status.
See zmq_getsockopt()
if you have problems with ZMQ::LibZMQ3 not knowing the type of the option.
$bytes = zmq_send($sock, $buffer, $size, $flags)
Queues $size
bytes from $buffer
to be sent from the socket. Argument $flags
may be omitted. If $size
is -1, then the size of the buffer calcualted via SvPV()
will be used.
Returns the number of bytes sent on success (which should be exact $size
)
Returns -1 upon failure, and sets $!.
$rv = zmq_sendmsg($sock, $message, $flags)
Queues $message
to be sent via $sock
. Argument $flags
may be omitted.
If $message
is a non-ref, creates a new ZMQ::LibZMQ3::Message object via zmq_msg_init_data()
, and uses that to pass to the underlying C layer..
Returns the number of bytes sent on success (which should be exact $size
)
Returns -1 upon failure, and sets $!.
Note: Deprecated in favor of zmq_msg_send()
, and may not be available depending on your libzmq version.
$rv = zmq_msg_send($message, $sock, $flags)
Queues $message
to be sent via $sock
. Argument $flags
may be omitted.
If $message
is a non-ref, creates a new ZMQ::LibZMQ3::Message object via zmq_msg_init_data()
, and uses that to pass to the underlying C layer..
Returns the number of bytes sent on success (which should be exact $size
)
Returns -1 upon failure, and sets $!.
Note: may not be available depending on your libzmq version.
$rv = zmq_recv($sock, $buffer, $len, $flags)
Receives a new message from $sock
, and store the message payload in $buffer
, up to $len
bytes. Argument $flags
may be omitted.
Returns the number of bytes in the original message, which may exceed $len
(if you have $rv
> $len
, then the message was truncated).
Returns -1 upon failure, and sets $!.
$message = zmq_recvmsg($sock, $flags)
Receives a new message from $sock
. Argument $flags
may be omitted. Returns the message object.
Returns undef upon failure, and sets $!.
Note: Although this function is marked as deprecated in libzmq3, it will stay in the Perl binding as the official short-circuit version of zmq_msg_recv()
, so that you don't have to create a message object every time.
$rv = zmq_msg_recv($msg, $sock, $flags)
Receives a new message from $sock
, and writes the new content to $msg
. Argument $flags
may be omitted. Returns 0 upon succes, -1 on failure and sets $!.
Other than the fact that libzmq has deprecated zmq_recvmsg()
, this construct is useful if you don't want to allocate a message struct for every recv call:
my $msg = zmq_msg_init();
while (1) {
my $rv = zmq_msg_recv($msg, $sock, $flags);
...
}
Note: may not be available depending on your libzmq version
$msg = zmq_msg_init()
Creates a new message object.
Returns undef upon failure, and sets $!.
$msg = zmq_msg_init_data($string)
Creates a new message object, and sets the message payload to the string in $string
.
Returns undef upon failure, and sets $!.
$msg = zmq_msg_init_size($size)
Creates a new message object, allocating $size
bytes. This call isn't so useful from within Perl
Returns undef upon failure, and sets $!.
$string = zmq_msg_data( $msg )
Returns the payload contained in $msg
$size = zmq_msg_size( $msg )
Returns the size of payload contained in $msg
zmq_msg_copy( $dst, $src )
Copies contents of $src
to $dst
.
Returns a non-zero status upon failure, and sets $!.
zmq_msg_move( $dst, $src )
Moves contents of $src
to $dst
Returns a non-zero status upon failure, and sets $!.
$rv = zmq_msg_close( $msg )
Closes, cleans up the message.
Returns a non-zero status upon failure, and sets $!.
$rv = zmq_poll( \@pollitems, $timeout )
@pollitems
are list of hash references containing the following elements:
- fd or socket
-
One of either
fd
orsocket
key must exist.fd
should contain a UNIX file descriptor.socket
should contain aZMQ::LibZMQ3::Socket
socket object. - events
-
A bit mask containing
ZMQ_POLLOUT
,ZMQ_POLLIN
,ZMQ_POLLERR
or combination there of. - callback
-
A subroutine reference, which will be called without arguments when the socket or descriptor is available.
In scalar context, returns the return value of zmq_poll() in the C layer, and sets $!.
my $rv = zmq_poll( .... ); # do scalar(zmq_poll(...)) if you're nuerotic
if ( $rv == -1 ) {
warn "zmq_poll failed: $!";
}
In list context, return a list containing as many booleans as there are elements in @pollitems
. These booleans indicate whether the socket in question has fired the callback.
my @pollitems = (...);
my @fired = zmq_poll( @pollitems ... );
for my $i ( 0 .. $#pollitems ) {
my $fired = $fired[$i];
if ( $fired ) {
my $item = $pollitems[$i];
...
}
}
zmq_version()
Returns the version of the underlying zeromq library that is being linked. In scalar context, returns a dotted version string. In list context, returns a 3-element list of the version numbers:
my $version_string = ZMQ::LibZMQ3::zmq_version();
my ($major, $minor, $patch) = ZMQ::LibZMQ3::zmq_version();
zmq_device($type, $sock1, $sock2)
Creates a new "device". See zmq_device
for details. zmq_device() will only return if/when the current context is closed. Therefore, the return value is always -1, and errno is always ETERM
Note: may not be available depending on your libzmq version.
zmq_proxy($frontend_sock, $backend_sock, $capture_sock)
WARNING: EXPERIMENTAL. Use at your own risk.
Start a proxy in the current thread, which connects the frontend socket to a backend socket. The capture sock is optional, and is by default undef.
Note: may not be available depending on your libzmq version.
$rv = zmq_socket_monitor($socket, $addr, events)
Note: may not be available depending on your libzmq version.
FUNCTIONS PROVIDED BY ZMQ::LIBZMQ3
These functions are provided by ZMQ::LibZMQ3 to make some operations easier in the Perl binding. They are not part of the official libzmq interface.
$value = zmq_getsockopt_int( $sock, $option )
$value = zmq_getsockopt_int64( $sock, $option )
$value = zmq_getsockopt_string( $sock, $option )
$value = zmq_getsockopt_uint64( $sock, $option )
$rv = zmq_setsockopt_int( $sock, $option, $value );
$rv = zmq_setsockopt_int64( $sock, $option, $value );
$rv = zmq_setsockopt_string( $sock, $option, $value );
$rv = zmq_setsockopt_uint64( $sock, $option, $value );
DEBUGGING XS
If you see segmentation faults, and such, you need to figure out where the error is occuring in order for the maintainers to figure out what happened. Here's a very very brief explanation of steps involved.
First, make sure to compile ZMQ::LibZMQ3
with debugging on by specifying -g:
perl Makefile.PL -g
make
Then fire gdb:
gdb perl
(gdb) R -Mblib /path/to/your/script.pl
When you see the crash, get a backtrace:
(gdb) bt
CAVEATS
This is an early release. Proceed with caution, please report (or better yet: fix) bugs you encounter.
This module has been tested againt zeromq 3.2.2. Semantics of this module rely heavily on the underlying zeromq version. Make sure you know which version of zeromq you're working with.
As of 1.04 some new constants have been added, but they are not really meant to be used by consumers of this module. If you find yourself looking at these, please let us know why you need to use it -- we'll see if we can find a workaround, or make these constants public.
SEE ALSO
http://github.com/lestrrat/p5-ZMQ
AUTHOR
Daisuke Maki <daisuke@endeworks.jp>
Steffen Mueller, <smueller@cpan.org>
COPYRIGHT AND LICENSE
The ZMQ::LibZMQ3 module is
Copyright (C) 2010 by Daisuke Maki
This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.8.0 or, at your option, any later version of Perl 5 you may have available.