Wrong resolution test result as failed when exception expected

[seregamorph]

For tests that declare expected exception like

@Test(expectedExceptions = SomeException.class)
public void testThrowsException() {

the framework does wrong test resolution as failed test:

[rieckpil]

thanks for reporting it.

As of now, I'm not so happy with the first implementation of the test result detection.

To support things like JUnit's @DisplayName, we would have to implement a JUnit Extension to get the actual test method name. This would bring yet something else to register apart from the test listener and context initializer.

Also, the parameterized test detection currently doesn't work (#6).

I'm not quite sure what's the best approach here:

• Re-implement the test stats
• Rely on the surefire/failsafe output? (I hope Gradle has something similar)

WDYT?

[seregamorph]

That's a good question. I solved similar problem analyzing xml reports of surefire/failsafe. But there are many limitations: these reports are not enabled by default may have custom configuration like file name, there is TestNG test engine that should enable it manually (it supports XML reports in JUnit format).
JUnit Platform listener could be an option, but keep in mind pure TestNG without testng-engine.

So, I understand current solution motivation, but I cannot give you any best advice there :D