NAME

Web::Scraper::Filter - Base class for Web::Scraper filters

SYNOPSIS

package Web::Scraper::Filter::YAML;
use base qw( Web::Scraper::Filter );
use YAML ();

sub filter {
    my($self, $value) = @_;
    YAML::Load($value);
}

1;

use Web::Scraper;

my $scraper = scraper {
    process ".yaml-code", data => [ 'TEXT', 'YAML' ];
};

DESCRIPTION

Web::Scraper::Filter is a base class for text filters in Web::Scraper. You can create your own text filter by subclassing this module.

There are two ways to create and use your custom filter. If you name your filter Web::Scraper::Filter::Something, you just call:

process $exp, $key => [ 'TEXT', 'Something' ];

If you declare your filter under your own namespace, like 'MyApp::Filter::Foo',

process $exp, $key => [ 'TEXT', '+MyApp::Filter::Foo' ];

You can also inline your filter function or regexp without creating a filter class:

process $exp, $key => [ 'TEXT', sub { s/foo/bar/ } ];

process $exp, $key => [ 'TEXT', qr/Price: (\d+)/ ];
process $exp, $key => [ 'TEXT', qr/(?<name>\w+): (?<value>\w+)/ ];

Note that this function munges $_ and returns the count of replacement. Filter code special cases if the return value of the callback is number and $_ value is updated.

You can, of course, stack filters like:

process $exp, $key => [ '@href', 'Foo', '+MyApp::Filter::Bar', \&baz ];

AUTHOR

Tatsuhiko Miyagawa