NAME
Bencher::Scenario::Switch::Startup - Benchmark the startup overhead of various switch modules
VERSION
This document describes version 0.001 of Bencher::Scenario::Switch::Startup (from Perl distribution Bencher-ScenarioBundle-SmartMatch), released on 2024-07-02.
SYNOPSIS
To run benchmark with default option:
% bencher -m Switch::StartupFor more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.
DESCRIPTION
Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.
BENCHMARKED MODULES
Version numbers shown below are the versions used when running the sample benchmark.
Switch::Right 0.000005
Switch::Back 0.000002
Switch::Perlish 1.0.5
Switch::Plain 0.0501
BENCHMARK PARTICIPANTS
Switch::Right (perl_code)
Switch::Back (perl_code)
Switch::Perlish (perl_code)
Switch::Plain (perl_code)
BENCHMARK SAMPLE RESULTS
Sample benchmark #1
Run on: perl: v5.38.2, CPU: Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz (2 cores), OS: GNU/Linux Ubuntu version 20.04, OS kernel: Linux version 5.4.0-164-generic.
Benchmark command (default options):
% bencher -m Switch::StartupResult formatted as table:
#table1#
+---------------------+-----------+-------------------+-----------------------+-----------------------+----------+---------+
| participant | time (ms) | mod_overhead_time | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |
+---------------------+-----------+-------------------+-----------------------+-----------------------+----------+---------+
| Switch::Right | 760 | 753.16 | 0.00% | 10969.46% | 0.0028 | 20 |
| Switch::Back | 620 | 613.16 | 21.83% | 8985.69% | 0.001 | 20 |
| Switch::Perlish | 20 | 13.16 | 3767.04% | 186.25% | 2.5e-05 | 20 |
| Switch::Plain | 13.2 | 6.36 | 5643.72% | 92.72% | 7.1e-06 | 20 |
| perl -e1 (baseline) | 6.84 | 0 | 10969.46% | 0.00% | 5.3e-06 | 20 |
+---------------------+-----------+-------------------+-----------------------+-----------------------+----------+---------+The above result formatted in Benchmark.pm style:
Rate Switch::Right Switch::Back Switch::Perlish Switch::Plain perl -e1 (baseline)
Switch::Right 1.3/s -- -18% -97% -98% -99%
Switch::Back 1.6/s 22% -- -96% -97% -98%
Switch::Perlish 50.0/s 3700% 3000% -- -34% -65%
Switch::Plain 75.8/s 5657% 4596% 51% -- -48%
perl -e1 (baseline) 146.2/s 11011% 8964% 192% 92% --
Legends:
Switch::Back: mod_overhead_time=613.16 participant=Switch::Back
Switch::Perlish: mod_overhead_time=13.16 participant=Switch::Perlish
Switch::Plain: mod_overhead_time=6.36 participant=Switch::Plain
Switch::Right: mod_overhead_time=753.16 participant=Switch::Right
perl -e1 (baseline): mod_overhead_time=0 participant=perl -e1 (baseline)To display as an interactive HTML table on a browser, you can add option --format html+datatables.
BENCHMARK NOTES
So, as I suspected, Switch::Right and Switch::Back has a large startup overhead, too large for my taste. Won't be using them anytime soon.
HOMEPAGE
Please visit the project's homepage at https://metacpan.org/release/Bencher-ScenarioBundle-SmartMatch.
SOURCE
Source repository is at https://github.com/perlancar/perl-Bencher-ScenarioBundle-SmartMatch.
AUTHOR
perlancar <perlancar@cpan.org>
CONTRIBUTING
To contribute, you can send patches by email/via RT, or send pull requests on GitHub.
Most of the time, you don't need to build the distribution yourself. You can simply modify the code, then test via:
% prove -lIf you want to build the distribution (e.g. to try to install it locally on your system), you can install Dist::Zilla, Dist::Zilla::PluginBundle::Author::PERLANCAR, Pod::Weaver::PluginBundle::Author::PERLANCAR, and sometimes one or two other Dist::Zilla- and/or Pod::Weaver plugins. Any additional steps required beyond that are considered a bug and can be reported to me.
COPYRIGHT AND LICENSE
This software is copyright (c) 2024 by perlancar <perlancar@cpan.org>.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.
BUGS
Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-ScenarioBundle-SmartMatch
When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.