NAME
Bencher::Scenario::Data::CSel::Selection - Benchmark selector
VERSION
This document describes version 0.041 of Bencher::Scenario::Data::CSel::Selection (from Perl distribution Bencher-Scenarios-Data-CSel), released on 2023-01-18.
SYNOPSIS
To run benchmark with default option:
% bencher -m Data::CSel::SelectionTo run module startup overhead benchmark:
% bencher --module-startup -m Data::CSel::SelectionFor more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.
DESCRIPTION
Sample documents from PERLANCAR::HTML::Tree::Examples are used.
Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.
BENCHMARKED MODULES
Version numbers shown below are the versions used when running the sample benchmark.
Data::CSel 0.128
BENCHMARK PARTICIPANTS
Data::CSel (perl_code)
Code template:
my @res = Data::CSel::csel({class_prefixes=>["Tree::Example::HashNode", "Tree::Example::ArrayNode"]}, <expr>, $main::trees{<tree>}); scalar @res
BENCHMARK DATASETS
small1-hash
16 elements, 4 levels (hash-based nodes).
small1-array
16 elements, 4 levels (array-based nodes).
medium1-hash
20k elements, 7 levels (hash-based nodes).
medium1-array
20k elements, 7 levels (array-based nodes).
SAMPLE BENCHMARK RESULTS
Run on: perl: v5.34.0, CPU: Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz (2 cores), OS: GNU/Linux Ubuntu version 20.04, OS kernel: Linux version 5.4.0-91-generic.
Benchmark with default options (bencher -m Data::CSel::Selection):
#table1#
+---------------+------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+
| dataset | arg_expr | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |
+---------------+------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+
| medium1-array | Sub4:first-child | 16 | 62 | 0.00% | 117641.82% | 0.0001 | 20 |
| medium1-hash | Sub4:first-child | 17 | 60 | 2.06% | 115263.45% | 8e-05 | 20 |
| medium1-array | Sub4 | 21 | 49 | 26.60% | 92904.89% | 0.00018 | 20 |
| medium1-hash | Sub4 | 21 | 48 | 27.79% | 92039.81% | 9.5e-05 | 20 |
| small1-hash | Sub4:first-child | 13500 | 0.0743 | 82729.42% | 42.15% | 2.6e-08 | 21 |
| small1-array | Sub4:first-child | 15000 | 0.065 | 93982.88% | 25.15% | 9.9e-08 | 23 |
| small1-hash | Sub4 | 16000 | 0.062 | 98974.93% | 18.84% | 1.1e-07 | 31 |
| small1-array | Sub4 | 19000 | 0.052 | 117641.82% | 0.00% | 9.2e-08 | 27 |
+---------------+------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+Formatted as Benchmark.pm result:
Rate medium1-array Sub4:first-child medium1-hash Sub4:first-child medium1-array Sub4 medium1-hash Sub4 small1-hash Sub4:first-child small1-array Sub4:first-child small1-hash Sub4 small1-array Sub4
medium1-array Sub4:first-child 16/s -- -3% -20% -22% -99% -99% -99% -99%
medium1-hash Sub4:first-child 17/s 3% -- -18% -19% -99% -99% -99% -99%
medium1-array Sub4 21/s 26% 22% -- -2% -99% -99% -99% -99%
medium1-hash Sub4 21/s 29% 25% 2% -- -99% -99% -99% -99%
small1-hash Sub4:first-child 13500/s 83345% 80653% 65848% 64502% -- -12% -16% -30%
small1-array Sub4:first-child 15000/s 95284% 92207% 75284% 73746% 14% -- -4% -20%
small1-hash Sub4 16000/s 99900% 96674% 78932% 77319% 19% 4% -- -16%
small1-array Sub4 19000/s 119130% 115284% 94130% 92207% 42% 25% 19% --
Legends:
medium1-array Sub4: arg_expr=Sub4 dataset=medium1-array
medium1-array Sub4:first-child: arg_expr=Sub4:first-child dataset=medium1-array
medium1-hash Sub4: arg_expr=Sub4 dataset=medium1-hash
medium1-hash Sub4:first-child: arg_expr=Sub4:first-child dataset=medium1-hash
small1-array Sub4: arg_expr=Sub4 dataset=small1-array
small1-array Sub4:first-child: arg_expr=Sub4:first-child dataset=small1-array
small1-hash Sub4: arg_expr=Sub4 dataset=small1-hash
small1-hash Sub4:first-child: arg_expr=Sub4:first-child dataset=small1-hashBenchmark module startup overhead (bencher -m Data::CSel::Selection --module-startup):
#table2#
+---------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------+
| participant | time (ms) | mod_overhead_time | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |
+---------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------+
| Data::CSel | 16 | 8.4 | 0.00% | 105.24% | 8.5e-05 | 20 |
| perl -e1 (baseline) | 7.6 | 0 | 105.24% | 0.00% | 3.3e-05 | 20 |
+---------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------+Formatted as Benchmark.pm result:
Rate D:C perl -e1 (baseline)
D:C 62.5/s -- -52%
perl -e1 (baseline) 131.6/s 110% --
Legends:
D:C: mod_overhead_time=8.4 participant=Data::CSel
perl -e1 (baseline): mod_overhead_time=0 participant=perl -e1 (baseline)To display as an interactive HTML table on a browser, you can add option --format html+datatables.
HOMEPAGE
Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenarios-Data-CSel.
SOURCE
Source repository is at https://github.com/perlancar/perl-Bencher-Scenarios-Data-CSel.
AUTHOR
perlancar <perlancar@cpan.org>
CONTRIBUTING
To contribute, you can send patches by email/via RT, or send pull requests on GitHub.
Most of the time, you don't need to build the distribution yourself. You can simply modify the code, then test via:
% prove -lIf you want to build the distribution (e.g. to try to install it locally on your system), you can install Dist::Zilla, Dist::Zilla::PluginBundle::Author::PERLANCAR, Pod::Weaver::PluginBundle::Author::PERLANCAR, and sometimes one or two other Dist::Zilla- and/or Pod::Weaver plugins. Any additional steps required beyond that are considered a bug and can be reported to me.
COPYRIGHT AND LICENSE
This software is copyright (c) 2023, 2017, 2016 by perlancar <perlancar@cpan.org>.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.
BUGS
Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenarios-Data-CSel
When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.