NAME

Fancazzista::Scrap

SYNOPSIS

use Fancazzista::Scrap;

my %config = (
    'websites' => [
        {
            name         => "Korben",
            url          => "https://korben.info",
            selector     => ".status-publish .entry-title",
            linkSelector => "a",
            textSelector => "a"
            limite       => 10 # optionnal 5 by default
        }
    ],
    'subreddits' => [
        {
            "name" => "javascript",
            "limit" => 10 # optionnal 5 by default
        }
    ],
    'devto' => [
        {
            "tag" => "perl",
            "limit" => 10 # optionnal 5 by default
        }
    ]
);

my @scrapped = Fancazzista::Scrap::scrapContent(\%config);

@scrapped :
[
    { 
        name => '<name>', 
        url => '<url'>, 
        articles => [
            { link => '<article-url>', text => '<article-title>' }
        ],
        from_devto => 1 # if source is dev.to
        from_website => 1 # if source if a website
        from_reddit => 1 # if source if reddit
    }
]   

DESCRIPTION

Perl module for scrap reddit post, dev.to post, website content. It only scrap article/post link and link text.

SEE ALSO

AUTHOR

Antoine MICELI, https://miceli.click

COPYRIGHT AND LICENSE

Copyright (C) 2020 by Antoine MICELI

This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.18.4 or, at your option, any later version of Perl 5 you may have available.