NAME

scrape.pl - Command-line data scraper

USAGE

-l                 # list all available backends

-b Backend engine  # scrape with a backend engine

-d data handler    # specify the default data handler

-D DSN             # the data source name, 
                   # e.g. 'DBI:mysql:database=db;host=localhost;port=3306'

-u user name       # the user name to database

-p password        # the password to database

-c                 # commit to database? (-D must be specified)

-C                 # cache fetched web pages

-i                 # use random time intervals between any two web requests

-L                 # max number of links to be fetched in one run

-T                 # max time for one run

-P                 # proxy server

-e                 # cache validation period

-h                 # show help message

COPYRIGHT

Copyright 2009-2010 by Yung-chung Lin

All right reserved. This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.