Changes for version 0.16 - 2016-01-14
- Added req event for such as request modification (gfdev).
Modules
A web crawling framework for Perl
Single crawler job
Crawler queue base class
Crawler queue with memory
Crawler queue with Mysql [EXPERIMENTAL]
Scraper utitlities
Crawler specific featured user agent