Changes for version 0.003
- fix encoding bug with taking md5 of content in FileCacher handler
- pod tests require RELEASE_TESTING=1
Documentation
parallel web crawler
Modules
web crawler
web crawler cache
web crawler handler
web crawler handler that caches files
web crawler queue
web crawler queue with DBI storage
web spider
web crawler utilities