v1.20-rc.1
Pre-release
Release 1.20 (Release candidate 1)
This release 1.20 extends the work on the support of data quality checks. This new release introduces the concept of multiple-instances for a single test definition. It means that you can run multiple the same test but with different parameters slightly affecting what is exactly tested. as an illustration, this new feature offers the opportunity to you create a single test asserting anything on all the files contained in a directory and named following a pattern of dates. To support this new major feature, we've introduced the concept of local variables. These variables are only valid in the scope of a test. The ways to define the possible values of these variables is already supporting a few use-cases such as loop with a sentinel or pre-defined lists. These variables can be used in the test but also to dynamically define traits and categories.
We've continued to work on the lookup assertions. With this release performances of the lookup-exists have been increased but we also add support to a new assertion checking that the value returned by a lookup is equal to the value contained in the result-set.
Another subset of features including on this releases are intended to improve the support of text files (csv ...). It's now possible to define a custom parser and to handle case where these files are missing.
As usual, this release also comes with some other improvements … especially around native transformations!
What's new
Framework
- #411 - Create several cases from one test's definition
- #431 - Support loop-sentinel with a duration step
- #466 - Support of half-open intervals for loop-sequences
- #434 - Support list of values when settling local-variable values
- #441 - Use local-variables to define categories and traits or customize test's name
- #405 - Support to check that columns resulting of a lookup match with expectations
- #442 - Support custom parsers for flat files
- #444 - Support a fallback to an empty result-set when a csv file is missing
- #449 - Define a result-set as the combination of sequences
- #443 - Support of custom conditions
- #436 - Directly define native-transformation applying to variables at different place where variables can be consumed.
- #468 - Native transformations available when defining expressions
- #403 - Add native transformations for numeric
- #403 - Add native transformations for clipping numeric and dateTime
- #427 - Add native transformations for text
- #435 - Add native transformations for dateTime related to month/year
- #463 - Add a native transformation to go to next/previous day/month/year
- #469 - Add a native transformation to set the date of a dateTime beta-available small-improvement