Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
List all non-passing tests in test summaries
This changes the default in pyproject.toml so that pytest lists a line for each non-passing test at the end of a run, showing the test name and, where available, condensed information about the status, such as the "reason" argument for an xfailing or skipped test. Previously only failed and errored tests were listed in the summary. Now skipped, xfailed, and xpassed tests are listed too. The benefit is in keeping track of the status of tests. Although showing the full failure output with stack trace and relevant code under test would be too distracting for tests marked xfail, it is valuable to not merely run those tests but be able to see a line showing their names and statuses. Likewise, a number of tests are currently marked skipped, and while some of them are skipped on a particular platform because they don't make sense to run on that platform, a number of others are skipped by raising SkipTest in response to a failure condition on Windows. (Those consist mostly of the tests skipped as a result of code discussed in #790.) This also has the more specific benefit of making it easier to mark tests as xfail in order to add CI jobs for native Windows, and more importantly to allow information about their status to later be used to understand and fix bugs on Windows.)
- Loading branch information