The London Perl and Raku Workshop takes place on 26th Oct 2024. If your company depends on Perl, please consider sponsoring and/or attending.

NAME

Test::Expander - Expansion of test functionalities that appear to be frequently used while testing.

SYNOPSIS

# Tries to automatically determine, which class / module and method / subroutine are to be tested,
# creates neither a temporary directory, nor a temporary file:
use Test::Expander;

# Tries to automatically determine, which class / module and method / subroutine are to be tested,
# creates neither a temporary directory, nor a temporary file,
# passes the option '-srand' to Test2::V0 changing the random seed to the current time in seconds:
use Test::Expander -srand => time;

# Class is supplied explicitly, tries to automatically determine method / subroutine to be tested,
# creates a temporary directory with name corresponing to the template supplied, does not create temporary file:
use Test::Expander -target => 'My::Class', -tempdir => { TEMPLATE => 'my_dir.XXXXXXXX' };

# Does not try to determine, which class / module and method / subroutine are to be tested,
# creates neither a temporary directory, nor a temporary file:
use Test::Expander -target => undef;

# Tries to automatically determine, which class / module is to be tested,
# does not determine method / subroutine to be tested,
# creates neither a temporary directory, nor a temporary file:
use Test::Expander -method => undef;

# Tries to automatically determine, which class / module is to be tested,
# does not create temporary file, creates a temporary directory and
# adds directories 'dir0' and 'dir1' located therein on top of the directory list used by the Perl interpreter
# for search of modules to be loaded. In other words, "unshifts" these directories to the @INC array:
use Test::Expander
  -lib => [
    'path( $TEMP_DIR )->child( qw( dir0 ) )->stringify',
    'path( $TEMP_DIR )->child( qw( dir1 ) )->stringify',
  ],
  -tempdir => {};

DESCRIPTION

The primary objective of Test::Expander is to provide additional convenience while testing based on Test2::V0 considering boilerplate aspects that seem to be important (to the author) in notable number of cases. These are among other things:

  • Repeated application of class / module and / or method / function to be tested. This, of course, can be stored in additional variables declared somewhere at the very beginning of test.

    Doing so, any refactoring including renaming of this class and / or method leads to the necessity to find and then to update all test files containing these names.

    If, however, both of these values can be determined from the path and base name of the current test file and saved in the exported read-only variables $CLASS and $METHOD, the only effort necessary in case of such renaming is a single change of path and / or base name of the corresponding test file.

    An additional benefit of suggested approach is a better readability of tests, where chunks like

    Foo::Bar->baz( $arg0, $arg1 )

    now look like

    $CLASS->$METHOD( $arg0, $arg1 )

    and hence clearly manifest that this chunk is about the testee.

  • The frequent necessity of introduction of temporary directory and / or temporary file usually leads to the usage of modules File::Temp::tempdir or Path::Tiny providing the methods / funtions tempdir and tempfile.

    This, however, can significantly be simplified (and the size of test file can be reduced) requesting such introduction via the options supported by Test::Expander:

    use Test::Expander -tempdir => {}, -tempfile => {};
  • Another fuctionality frequently used in tests relates to the work with files and directories: reading, writing, creation, etc. Because almost all features required in such cases are provided by Path::Tiny, some functions of this module is also exported from Test::Expander.

  • Last but not least. To provide a really environment-independent testing, we might need a possibility to run our tests in a clean environment, where only explicitly mentioned environment variables are set and environment variables from the "outside world" cannot affect the execution of tests. This can also be achieved manually by manipulation of %ENV hash at the very beginning of tests. However, even ignoring the test code inflation, this might be (in fact - is) necessary in many tests belonging to one and the same module, so that a possibility to outsource the definition of test environment provided by Test::Expander makes tests smaller, more maintainable, and much more reliable.

Test::Expander combines all advanced possibilities provided by Test2::V0 with some specific functions only available in the older module Test::More (which allows a smooth migration from Test::More-based tests to Test2::V0-based ones) and handy functions from some other modules often used in test suites.

Furthermore, this module allows to automatically recognize the class / module to be tested (see variable $CLASS below) so that in contrast to Test2::V0 you do not need to specify this explicitly if the path to the test file is in accordance with the name of class / module to be tested i.e. file t/Foo/Bar/baz.t corresponds to class / module Foo::Bar.

If such automated recognition is not intended, this can be deactivated by explicitly supplied undefined class / module name along with the option -target.

A similar recognition is provided in regard to the method / subroutine to be tested (see variables $METHOD and $METHOD_REF below) if the base name (without extension) of test file is identical with the name of this method / subroutine i.e. file t/Foo/Bar/baz.t corresponds to method / subroutine Foo::Bar::bar.

Finally, a configurable setting of specific environment variables is provided so that there is no need to hard-code this in the test itself.

The following options are accepted:

  • Options specific for this module only are always expected to have values and their meaning is:

    • -lib - prepend directory list used by the Perl interpreter for search of modules to be loaded (i.e. the @INC array) with values supplied in form of array reference. Each element of this array is evaluated using string eval so that expression evaluated to strings are supported.

      Among other things this provides a possibility to temporary expand the module search path by directories located in the temporary directory if the latter is defined with the option -tempdir (see below).

      -lib is interpreted as the very last option, that's why the variables defined by Test::Expander for export e.g. $TEMP_DIR can be used in the expressions determining such directories (see SYNOPSYS above).

    • -method - prevent any attempt to automatically determine method / subroutine to be tested. If the value supplied along with this option is defined and found in the class / module to be test (see -target below), this will be considered such method / subroutine so that the variables $METHOD and $METHOD_REF (see description of exported variables below) will be imported and accessible in test. If this value is undef, these variables are not imported.

    • -target - identical to the same-named option of Test2::V0 and, if contains a defined value, has the same purpose namely the explicit definition of the class / module to be tested as the value. However, if its value is undef, this is not passed through to Test2::V0 so that no class / module will be loaded and the variable $CLASS will not be imported at all.

    • -tempdir - activates creation of a temporary directory. The value has to be a hash reference with content as explained in File::Temp::tempdir. This means, you can control the creation of temporary directory by passing of necessary parameters in form of a hash reference or, if the default behavior is required, simply pass the empty hash reference as the option value.

    • -tempfile - activates creation of a temporary file. The value has to be a hash reference with content as explained in File::Temp::tempfile. This means, you can control the creation of temporary file by passing of necessary parameters in form of a hash reference or, if the default behavior is required, simply pass the empty hash reference as the option value.

  • All other valid options (i.e. arguments starting with the dash sign -) are forwarded to Test2::V0 along with their values.

    Options without values are not supported; in case of their passing an exception is raised.

  • If an argument cannot be recognized as an option, an exception is raised.

Test::Expander is recommended to be the very first module in your test file.

The known exceptions are:

  • When another module is used, which in turn is based on Test::Builder e.g. Test::Output:

    use Test::Output;
    use Test::Expander;
  • When some actions performed on the module level (e.g. determination of constants) rely upon results of other actions (e.g. mocking of built-ins).

    To explain this let us assume that your test file should mock the built-in close to verify if the testee properly reacts both on its success and failure. For this purpose a reasonable implementation might look as follows:

    my $closeSuccess = 1;
    BEGIN {
      *CORE::GLOBAL::close = sub (*) { return $closeSuccess ? CORE::close($_[0]) : 0 }
    }
    
    use Test::Expander;

The automated recognition of name of class / module to be tested can only work if the test file is located in the corresponding subdirectory. For instance, if the class / module to be tested is Foo::Bar::Baz, then the folder with test files related to this class / module should be t/Foo/Bar/Baz or xt/Foo/Bar/Baz (the name of the top-level directory in this relative name - t, or xt, or my_test is not important) - otherwise the module name cannot be put into the exported variable $CLASS and, if you want to use this variable, should be supplied as the value of -target:

use Test::Expander -target => 'Foo::Bar::Baz';

This recognition can explicitly be deactivated if the value of -target is undef, so that no class / module will be loaded and, correspondingly, the variables $CLASS, $METHOD, and $METHOD_REF will not be exported.

Furthermore, the automated recognition of the name of the method / subroutine to be tested only works if the file containing the class / module mentioned above exists and if this class / module has the method / subroutine with the same name as the test file base name without the extension. If this is the case, the exported variables $METHOD and $METHOD_REF contain the name of method / subroutine to be tested and its reference, correspondingly, otherwise both variables are neither evaluated nor exported.

Also in this case evaluation and export of the variables $METHOD and $METHOD_REF can be prevented by passing of undef as value of the option -method:

use Test::Expander -target => undef;

Finally, Test::Expander supports testing inside of a clean environment containing only some clearly specified environment variables required for the particular test. Names and values of these environment variables should be configured in files, the names of which are identical with paths to single class / module levels or the method / subroutine to be tested, and the extension is always .env. For instance, if the test file name is t/Foo/Bar/Baz/myMethod.t, the following approach is applied:

  • if the file t/Foo.env exists, its content is used for the initialization of the test environment,

  • if the file t/Foo/Bar.env exists, its content is used either to extend the test environment initialized in the previous step or for its initialization if t/Foo.env does not exist,

  • if the file t/Foo/Bar/Baz.env exists, its content is used either to extend the test environment initialized in one of the previous steps or for its initialization if neither t/Foo.env nor t/Foo/Bar.env exist,

  • if the file t/Foo/Bar/Baz/myMethod.env exists, its content is used either to extend the test environment initialized in one of the previous steps or for its initialization if none of .env files mentioned above exist.

If the .env files existing on different levels have identical names of environment variables, the priority is the higher the later they have been detected. I.e. VAR = 'VALUE0' in t/Foo/Bar/Baz/myMethod.env overwrites VAR = 'VALUE1' in t/Foo/Bar/Baz.env.

If none of these .env files exist, the environment isn't changed by Test::Expander during the execution of t/Foo/Bar/Baz/myMethod.t.

An environment configuration file (.env file) is a line-based text file. Its content is interpreted as follows:

  • if such files don't exist, the %ENV hash remains unchanged;

  • otherwise, if at least one of such files exists, those elements of %ENV are kept, which names are equal to names found in lines of .env file without values. All remaining elements of the %ENV gets emptied (without localization) and

    • lines not matching the RegEx /^\w+\s*(?:=\s*\S|$)?/ (some alphanumeric characters representing a name of environment variable, optional blanks, optionally followed by the equal sign, again optional blanks, and at least one non-blank character representing the first character of environment variable value) are skipped;

    • in all other lines the value of the environment variable is everything from the first non-blank character after the equal sign until end of the line; if this value is omitted, the corresponding environment variable remains unchanged as it originally was in the %ENV (if it existed there, of course);

    • the value of the environment variable (if provided) is evaluated by the string eval so that

      • constant values must be quoted;

      • variables and subroutines must not be quoted:

        NAME_CONST = 'VALUE'
        NAME_VAR   = $KNIB::App::MyApp::Constants::ABC
        NAME_FUNC  = join(' ', $KNIB::App::MyApp::Constants::DEF)

All environment variables set up in this manner are logged to STDOUT using note.

Another common feature within test suites is the creation of a temporary directory / file used as an isolated container for some testing actions. The module options -tempdir and -tempfile are fully syntactically compatible with File::Temp::tempdir / File::Temp::tempfile. They make sure that such temporary directory / file are created after use Test::Expander and that their names are stored in the variables $TEMP_DIR / $TEMP_FILE, correspondingly. Both temporary directory and file are removed by default after execution.

The following functions provided by this module are exported by default:

  • all functions exported by default from Test2::V0,

  • all functions exported by default from Test2::Tools::Explain,

  • some functions exported by default from Test::More and often used in older tests but not supported by Test2::V0:

    • BAIL_OUT,

    • is_deeply,

    • new_ok,

    • require_ok,

    • use_ok.

  • some functions exported by default from Test::Exception and often used in older tests but not supported by Test2::V0:

    • dies_ok,

    • lives_ok,

    • throws_ok.

    some functions exported by default from Test2::Tools::Explain and often used in older tests but not supported by Test2::Tools::Explain:

    • explain.

  • function exported by default from Const::Fast:

    • const.

  • some functions exported by request from File::Temp:

    • tempdir,

    • tempfile,

  • some functions exported by request from Path::Tiny:

    • cwd,

    • path,

The following variables can be set and exported:

  • variable $CLASS containing the name of the class / module to be tested if the class / module recognition is not disable and possible,

  • variable $METHOD containing the name of the method / subroutine to be tested if the method / subroutine recognition is not disable and possible,

  • variable $METHOD_REF containing the reference to the subroutine to be tested if the method / subroutine recognition is not disable and possible,

  • variable $TEMP_DIR containing the name of a temporary directory created at compile time if the option -tempdir is supplied,

  • variable $TEMP_FILE containing the name of a temporary file created at compile time if the option -tempfile is supplied.

  • variable $TEST_FILE containing the absolute name of the current test file. In fact its content is identical with the content of special token __FILE__, but only in the test file itself! If, however, you need the test file name in a test submodule or in a .env file belonging to this test, __FILE__ can no longer be applied - whereas $TEST_FILE is there.

All variables mentioned above are read-only after their export. In this case they are logged to STDOUT using note.

AUTHOR

Jurij Fajnberg, <fajnbergj at gmail.com>

BUGS

Please report any bugs or feature requests through the web interface at https://github.com/jsf116/Test-Expander/issues.

COPYRIGHT AND LICENSE

Copyright (c) 2021-2023 Jurij Fajnberg

This program is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.