The London Perl and Raku Workshop takes place on 26th Oct 2024. If your company depends on Perl, please consider sponsoring and/or attending.
 / 
WWW-Crawler-Lite-0.004
River stage zero No dependents

Changes for version v0.004 - 2012-01-08

  • Thanks to TOBYINK++ for pointing out that application/xhtml+xml is the correct way to accept text/xhtml.
  • Thanks to the.tuxster++ for submitting a patch to allow for a 'follow_ok' callback to be called for each link found within a response.
  • Thanks to bart++ from PerlMonks.org for pointing out that using HTML::LinkExtor for parsing the links in a page is a much better approach than a simple regexp.

Modules

WWW::Crawler::Lite
A single-threaded crawler/spider for the web.

Other files