Skip to content
This repository has been archived by the owner on Apr 13, 2023. It is now read-only.

Summary test results are to be calculated when all tests are completed #643

Open
LisiLisenok opened this issue Nov 24, 2016 · 0 comments
Open
Labels
Milestone

Comments

@LisiLisenok
Copy link

Currently, it looks like the summary test results are calculated when test is submitted by the test framework or when test framework guess the test is completed (possibly, without sending test finished event) but actually the test might be not completed yet.

Suppose I have a test executor which doesn't execute test when it submitted, but collects all tests and executes all of them later.

see, such executor on the gist

There is total 2 test functions in 2 classes in the example. If run the tests the summary results are:

  • total tests 2
  • total success 2
  • total skipped 1

Why number of skipped tests is 1? Which test has been skipped? All tests have been successfully completed.
So, I propose to calculate the summary results after all tests in the run completed or at least when test finished event is sent.

@bjansen bjansen added the m-test label Jan 5, 2017
@bjansen bjansen modified the milestone: 1.3.2 Jan 5, 2017
@quintesse quintesse modified the milestones: 1.3.2, 1.3.3 Mar 3, 2017
@FroMage FroMage modified the milestones: 1.3.3, 1.4.0 beta Sep 6, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

4 participants