NAME

TaskPipe::Task_Scrape::Settings - settings for TaskPipe::Task_Scrape

METHODS

max_retries

The maximum number of times to retry if the request fails

require_referer

Exit with an error if set to 1 and no referer is provided (alongside url)

require_url

Exit with an error if set to 1 and no url is provided. If set to zero and no url is provided, the task will return an empty list

ua_mgr_module

The UserAgentManager module to use

ua_handler_module

The UserAgentHandler module to use

AUTHOR

Tom Gracey <tomgracey@gmail.com>

COPYRIGHT AND LICENSE

Copyright (c) Tom Gracey 2018

TaskPipe is free software, licensed under

The GNU Public License Version 3