/ 
WWW-Crawler-Mojo-0.09
River stage one • 1 direct dependent • 1 total dependent
/ WWW::Crawler::Mojo::Job

NAME

WWW::Crawler::Mojo::Job - Single crawler job

SYNOPSIS

my $job1 = WWW::Crawler::Mojo::Job->new;
$job1->resolved_uri('http://example.com/');
my $job2 = $job1->child;

DESCRIPTION

This class represents a single crawler job.

ATTRIBUTES

literal_uri

A Mojo::URL instance of the literal URL that has appeared in the referrer document.

$job1->literal_uri('./index.html');
say $job1->literal_uri; # './index.html'

resolved_uri

A Mojo::URL instance of the resolved URL.

$job1->resolved_uri('http://example.com/');
say $job1->resolved_uri; # 'http://example.com/'

referrer

A job instance that has referred the URL.

$job1->referrer($job);
my $job2 = $job1->referrer;

redirect_history

An array reference that contains URLs of redirect history.

$job1->redirect_history([$url1, $url2, $url3]);
my $history = $job1->redirect_history;

method

HTTP request method such as get or post.

$job1->method('GET');
say $job1->method; # GET

tx_params

A hash reference that contains params for Mojo::Transaction.

$job1->tx_params({foo => 'bar'});
$params = $job1->tx_params;

METHODS

clone

Clones the job.

my $job2 = $job1->clone;

child

Instantiate a child job by parent job. The parent uri is set to child referrer.

my $job1 = WWW::Crawler::Mojo::Job->new(resolved_uri => 'http://a/1');
my $job2 = $job1->child(resolved_uri => 'http://a/2');
say $job2->referrer->resolved_uri # 'http://a/1'

depth

Counts the depth of job in referrer series.

my $job1 = WWW::Crawler::Mojo::Job->new;
my $job2 = $job1->child;
my $job3 = $job2->child;
say $job1->depth; # 0
say $job2->depth; # 1
say $job3->depth; # 2

redirect

Replaces the resolved URI and history at once.

my $job = WWW::Crawler::Mojo::Job->new;
$job->resolved_uri($url1);
$job->redirect($url2, $url3);
say $job->resolved_uri # $url2
say $job->redirect_history # [$url1, $url3]

original_uri

Returns the original URI of redirected job. If redirected, returns last element of redirect_histroy attribute, otherwise returns resolved_uri attribute.

$job1->redirect_history([$url1, $url2, $url3]);
my $url4 = $job1->original_uri; # $url4 is $url3

AUTHOR

Sugama Keita, <sugama@jamadam.com>

COPYRIGHT AND LICENSE

Copyright (C) Sugama Keita.

This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.