NAME
TaskPipe::Task_Scrape::Settings - settings for TaskPipe::Task_Scrape
METHODS
- max_retries
-
The maximum number of times to retry if the request fails
- require_referer
-
Exit with an error if set to 1 and no referer is provided (alongside url)
- require_url
-
Exit with an error if set to 1 and no url is provided. If set to zero and no url is provided, the task will return an empty list
- ua_mgr_module
-
The UserAgentManager module to use
- ua_handler_module
-
The UserAgentHandler module to use
AUTHOR
Tom Gracey <tomgracey@gmail.com>
COPYRIGHT AND LICENSE
Copyright (c) Tom Gracey 2018
TaskPipe is free software, licensed under
The GNU Public License Version 3