/ 
Bencher-Scenarios-ShellGuess-0.003
River stage one • 1 direct dependent • 1 total dependent
/ Bencher::Scenario::ShellGuess::Overhead

NAME

Bencher::Scenario::ShellGuess::Overhead - Benchmark the startup overhead of guessing shell

VERSION

This document describes version 0.003 of Bencher::Scenario::ShellGuess::Overhead (from Perl distribution Bencher-Scenarios-ShellGuess), released on 2021-07-31.

SYNOPSIS

To run benchmark with default option:

% bencher -m ShellGuess::Overhead

For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.

DESCRIPTION

Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.

BENCHMARK PARTICIPANTS

  • load Shell::Guess (command)

  • load Shell::Guess + running_shell (command)

  • perl (baseline) (command)

BENCHMARK SAMPLE RESULTS

Sample benchmark #1

Run on: perl: v5.24.0, CPU: Intel(R) Core(TM) i5-2400 CPU @ 3.10GHz (4 cores), OS: GNU/Linux Debian version 8.0, OS kernel: Linux version 3.16.0-4-amd64.

Benchmark command (under bash):

%

Result formatted as table:

#table1#
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| participant                       | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest |  errors | samples |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| load Shell::Guess + running_shell |        98 |      10   |    0                  |      3.74052667964341 | 3.8e-05 |      21 |
| load Shell::Guess                 |       100 |       9.7 |    0.0517047248148278 |      3.50746922381476 |   3e-05 |      20 |
| perl (baseline)                   |       460 |       2.2 |    3.74052667964341   |      0                | 1.1e-05 |      20 |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+

The above result formatted in Benchmark.pm style:

                                     Rate  load Shell::Guess + running_shell  load Shell::Guess  perl (baseline) 
 load Shell::Guess + running_shell   98/s                                 --                -3%             -78% 
 load Shell::Guess                  100/s                                 3%                 --             -77% 
 perl (baseline)                    460/s                               354%               340%               -- 

Legends:
  load Shell::Guess: participant=load Shell::Guess
  load Shell::Guess + running_shell: participant=load Shell::Guess + running_shell
  perl (baseline): participant=perl (baseline)

The above result presented as chart:

Sample benchmark #2

Benchmark command (under fish):

%

Result formatted as table:

#table2#
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| participant                       | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest |  errors | samples |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| load Shell::Guess + running_shell |        99 |      10   |    0                  |      4.50965048854215 | 4.6e-05 |      21 |
| load Shell::Guess                 |       100 |       9.7 |    0.0452853002877057 |      4.27095376451354 | 3.4e-05 |      20 |
| perl (baseline)                   |       550 |       1.8 |    4.50965048854215   |      0                | 6.6e-06 |      21 |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+

The above result formatted in Benchmark.pm style:

                                     Rate  load Shell::Guess + running_shell  load Shell::Guess  perl (baseline) 
 load Shell::Guess + running_shell   99/s                                 --                -3%             -82% 
 load Shell::Guess                  100/s                                 3%                 --             -81% 
 perl (baseline)                    550/s                               455%               438%               -- 

Legends:
  load Shell::Guess: participant=load Shell::Guess
  load Shell::Guess + running_shell: participant=load Shell::Guess + running_shell
  perl (baseline): participant=perl (baseline)

The above result presented as chart:

Sample benchmark #3

Benchmark command (under tcsh ('c')):

%

Result formatted as table:

#table3#
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| participant                       | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest |  errors | samples |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| load Shell::Guess + running_shell |       100 |      10   |    0                  |      3.66106761739065 | 4.6e-05 |      20 |
| load Shell::Guess                 |       100 |       9.7 |    0.0311256049185042 |      3.52036841598851 | 4.7e-05 |      20 |
| perl (baseline)                   |       500 |       2   |    3.66106761739065   |      0                | 4.7e-05 |      20 |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+

The above result formatted in Benchmark.pm style:

                                     Rate  load Shell::Guess + running_shell  load Shell::Guess  perl (baseline) 
 load Shell::Guess + running_shell  100/s                                 --                -3%             -80% 
 load Shell::Guess                  100/s                                 3%                 --             -79% 
 perl (baseline)                    500/s                               400%               384%               -- 

Legends:
  load Shell::Guess: participant=load Shell::Guess
  load Shell::Guess + running_shell: participant=load Shell::Guess + running_shell
  perl (baseline): participant=perl (baseline)

The above result presented as chart:

Sample benchmark #4

Benchmark command (under zsh ('z')):

%

Result formatted as table:

#table4#
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+
| participant                       | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest |  errors   | samples |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+
| load Shell::Guess                 |       100 |        10 |    0                  |      4.17013158922127 |   0.00011 |      20 |
| load Shell::Guess + running_shell |        99 |        10 |    0.0309140475235712 |      4.01509471293053 |   5e-05   |      20 |
| perl (baseline)                   |       500 |         2 |    4.17013158922127   |      0                | 2.6e-05   |      20 |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+

The above result formatted in Benchmark.pm style:

                                     Rate  load Shell::Guess  load Shell::Guess + running_shell  perl (baseline) 
 load Shell::Guess                  100/s                 --                                 0%             -80% 
 load Shell::Guess + running_shell   99/s                 0%                                 --             -80% 
 perl (baseline)                    500/s               400%                               400%               -- 

Legends:
  load Shell::Guess: participant=load Shell::Guess
  load Shell::Guess + running_shell: participant=load Shell::Guess + running_shell
  perl (baseline): participant=perl (baseline)

The above result presented as chart:

To display as an interactive HTML table on a browser, you can add option --format html+datatables.

HOMEPAGE

Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenarios-ShellGuess.

SOURCE

Source repository is at https://github.com/perlancar/perl-Bencher-Scenarios-ShellGuess.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenarios-ShellGuess

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.

SEE ALSO

AUTHOR

perlancar <perlancar@cpan.org>

COPYRIGHT AND LICENSE

This software is copyright (c) 2021, 2017, 2016 by perlancar@cpan.org.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.