-
Notifications
You must be signed in to change notification settings - Fork 21
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
In the "**Runs**" tab, the real status for tests with the **@mark.xfail** mark is not displayed #240
Comments
@BohdanObruch what did you use to report the results to testomat.io? please give command example from terminal |
I use |
and what is somewhat interesting: |
will check and fix on weekend |
@BohdanObruch sorry for a delay. I was sick. I've looked through your issue and cannot figure out how to help you. There is no such status in testomat.io like xpassed. There only 3 |
do you suggest to fail this test in testomat.io? |
with such a launch as you indicated there, regardless of the pytest marks in the test, only the status of either passed or failed will be displayed |
@Ypurek @BohdanObruch
it's tricky part how to treat xfail and xpass
I think, the mapping from pytest's statuses to testomat.io's statuses should be like this:
However, I suggest to put message for test case for following statuses to it's visible in the list:
@DavertMik I think we need to introduce labels and custom fields for testrun |
@poliarush thank you, I agree with you |
related to testomatio/app#881 @BohdanObruch also, i've created a new item to introduce labels and custom fields for testrun, so then you can customly assign necessary labels to testruns and filter by it with some statistics |
Closed in favor of testomatio/app#881 |
Describe the bug
In the "Runs" tab, the real status for tests with the @mark.xfail mark is not displayed
Precondition
Create a test and add pytest mark with this test @mark.xfail
To Reproduce
Steps to reproduce:
Expected behavior
The status of the test should be "xpassed" and with a display of why.
For example, how the reason for failed tests is displayed
Screenshots
Desktop (please complete the following information):
The text was updated successfully, but these errors were encountered: