-*-Outline-*-
LectroTest Change Log
Tom Moertel (tom@moertel.com)
* 0.3600 (2007-08-30)
** Misc
- Test suite for generators now emits notice that a failure may
not indicate a real problem. (rt.cpan.org #28203)
- Minor typo fixes in the documentation.
* 0.3500 (2006-05-31)
** Improvements
- Added failure recording and playback, which is great for building
regression-testing suites and for recording failures in the wild.
Both Test::LectroTest and Test::LectroTest::Compat take the
following options:
- playback_failures => file
- record_failures => file
- regressions => file
The first tells LT to use the prerecorded failures in the given file
for playback during testing, *in addition to* the normal randomly
generated cases. The second tells LT to record any failures that
occur during testing. The failures will be written to the given
file. The third is a shorthand for setting the first two options to
the same file. It is a more readable way to declare your intent to
build up and use a persistent regressions file.
These options are documented more fully in the docs for
Test::LectroTest::TestRunner.
** Misc
- I'm now using Module::Signature to sign the Test::LectroTest
distribution.
* 0.3400 (2006-01-18)
** Improvements
- $tcon->dump( val, ... ) now returns val as its result so that
the method call can be used to record values in passing.
- Added Pod and Pod-coverage tests. Tweaked the code to satisfy them.
* 0.3300 (2005-07-20)
** Fixes
- Test::LectroTest can now be listed as a dependency in an
ExtUtils::MakeMaker Makefile.PL. (Thanks Steffen Müller)
** Misc
- Minor documentation tweaks for clarity.
- Minor code clean ups.
* 0.3200 (2005-03-03)
** Improvements
- You can now attach notes and variable dumps to trials. In the
event the trial fails, the notes will be emitted as part of the
counterexample to aid in debugging.
See Test::LectroTest::TestRunner::testcontroller for the
documentation on the new $tcon->note() and $tcon->dump() methods.
- Strings in counterexamples are now printed in double-quoted form.
This makes it easy to see invisibles.
* 0.3100 (2005-02-19)
- This release is identical to 0.3000 except that for this release I
did not screw up the version numbering in the distribution tarball.
(Ouch!)
* 0.3000 (2005-02-19)
** Improvements
- Full test coverage! Devel::Coverage says that the LT unit tests now
cover 100% of statements, branches, conditionals, and subroutines.
- Test::LectroTest now follows Test::Simple's exit-code strategy:
The number of failures (up to 254) is reported via the exit code.
- (!) Test::LectroTest::TestRunner::run_suite now returns the number
of properties that successfully checked. (Before it reported 0 if
any check failed.) !!!NOTE!!! This is an API change. If you have
written code that checks the result of run_suite, you will need to
change it.
** Fixes
- An empty suite powered by Test::LectroTest now emits "1..0"
as its sole output when previously there was no output.
** Misc
- Added a bunch of new test cases.
- Renamed test files: from t/001.t to t/gens.t, etc.
- Removed superfluous use of Data::Dumper in t/gens.t.
- Relaxed dependencies on external packages need only for building.
* 0.2010 (2005-02-16)
** Improvements
- Now you can mix LectroTest and Test::* modules!
Test::LectroTest::Compat provides the compatibility magic.
** Fixes
- Updated copyright notices.
- Removed use of List::Util from t/001.t. (This should be
the last use of the module. Now we can cut the dependency.)
- Renamed the test .t files to something sensible.
** Misc
- Made list of dependencies in Build.PL pedantically complete.
* 0.2008 (2005-02-05)
** Improvements
- Paste can now be used to join elements of generated lists,
which are "flattened" before pasting. For example, the
following are equivalent:
Paste( (Bool) x 4 )
Paste( List(Bool, length=>4) )
- Removed dependency upon Data::Dumper's Sortkeys method and
upon List::Util entirely. This makes LectroTest compatible with
older versions of Perl. (I tested on v5.6.1 built for i386-linux.)
Thanks Alex Kapranoff for the Sortkeys dependency report.
** Fixes
- Minor clarifying edits to documentation.
* 0.2007 (2004-09-30)
** Improvements
- You can now specify multiple sets of generator-bindings for a
property. This lets you focus on specific portions of your test
space to ensure the desired coverage. For example, if you wanted
to cover all integers but especially focus on the range [-1,1]:
Property {
##[ x <- Int ], [ x <- Int(range=>[-1,1]) ]##
blah($x) != 0
}, name => "blah result is non-zero" ;
- Generator now accepts an :all export tag to export everything
(which is what I use almost all of the time).
- If a generator throws an exception, it is caught and reported
specifically in a special warning counterexample.
- Expanded test suite for TestRunner and Property.
** Fixes
- Some of the new combinators were listed under the :common
export tag instead of under :combinators.
* 0.2006 New combinators, doc fixes (2004-09-15)
** Improvements
- More new combinators that you can shake a stick at:
Each, Apply, Map, Concat, Flatten, ConcatMap, FlattenMap.
- As usual, documentation tweaks:
- Better explanation of sizing guidance (Generator)
- Added warnings about empty ranges, etc. (Generator)
- Documented the new combinators (Generator)
- Additional pre-flight checks for Int and Float generators:
If a range is provided that does not contain zero, LectroTest
will complain if the generator is also sized (because the
run-time intersection of the sizing-guidance range and the
generator's range can be empty, making it impossible to
generate a valid value).
** Fixes
- Fixed an overly-uppity pre-flight check for List(length=>N).
- Fixed TestRunner's modifying of $" in a way that escaped into the
behavior-test part of Properties during checks.
* 0.2005 Re-release of 0.2004 to make CPAN happy (2004-09-13)
- I once had a version in Test::LectroTest::Generator but removed it
because I wanted to version only the entire Test::LectroTest module.
But CPAN rejected Generator because its version had "fallen." Crap.
So, back in goes the version number, now bumped.
* 0.2004 Documentation improvements, minor code improvements (2004-09-13)
** Fixes
- Some links in documentation were broken.
** Improvements
- Vastly improved docs: All modules now have decent documentation.
(Tutorial still needs step-by-steps, tho.)
- More pre-flight checks and better error reporting.
- Cleaned up Test::LectroTest's hack for running property checks and
end of load.
* 0.2003 Bug fix and doc improvements (2004-09-11)
** Fixes
- !! Important fix: In generator bindings with more than one variable,
variables sometimes got each others' values.
** Improvements
- Updated docs.
- LectroTest::Property now pre-flight checks for the use of $tcon in a
generator binding and emits and error in that case. ($tcon is used
for the test controller.)
- TestRunner will now catch and report exceptions thrown during
property checks:
- A thrown exception results in test failure.
- The "details" report will include a "Caught exception" section,
if needed.
- TestRunner::results now has an exception field:
- undef if no exception was thrown during testing
- the exception otherwise
* 0.2002 Documentation improvements (2004-09-09)
- Added README (d'oh!) from Test::LectroTest.
- Updated docs in Test::LectroTest.
* 0.2001 First Pre-CPAN upload release (2004-09-09)
- Major documentation improvements
- Lots of cleanups
- Reorg under Test:
LectroTest::* -> Test::LectroTest::*
LectroTest::Simple -> Test::LectroTest
* 0.1002 First public release (2004-09-08)
- Clean ups
* 0.1001 First cut