How do I remove some of the test results from Allure Report?

[cb-barathi]

I am using a Cucumber and TestNG-based framework with Gradle as the build tool, and I use io.qameta.allure:allure-cucumber7-jvm to generate Allure reports. I execute the Cucumber tests using a testng.xml file. However, the generated Allure report contains duplicate test results: one set generated via TestNG and another set generated via the Cucumber feature files.

I want to display only the test results based on the Cucumber feature files and exclude the TestNG-based test results. I am not using any TestNG annotations in my code, only Cucumber-based annotations.

Is there a way to remove the TestNG-based results from the report during execution?

I am using:

Cucumber: 7.10.0
TestNG: 7.5
Gradle: 7.x
Allure: with TestNG and Cucumber7 (io.qameta.allure:allure-cucumber7-jvm)

[baev]

Could you please specify the version of io.qameta.allure:allure-cucumber7-jvm and the version of io.qameta.allure:allure-testng (if added as a dependency)

[cb-barathi]

Hi baev, able to remove the testng based test results from allure report using gradle task.

tasks.register("filterAllureResults") {
    doLast {
        def allureResultsDir = file("${buildDir}/allure-results")
        if (allureResultsDir.exists()) {
            allureResultsDir.eachFile { file ->
                if (file.text.contains("io.cucumber.testng.AbstractTestNGCucumberTests.runScenario")) {
                    file.delete()
                }
            }
        }
    }
}

thank you.

[baev]

I was asking because the issue is fixed in the latest versions, and allure-testing will not report the results for the cucumber tests if allure-cucumberjvm is detected in the classpath. See https://github.com/allure-framework/allure-java/blob/main/allure-testng/src/main/java/io/qameta/allure/testng/AllureTestNg.java#L313-L329

If you're using the autoconfigure feature from the Allure Gradle plugin, you may need to set allureJavaVersion to 2.29.1. If you're already using the correct versions (you can check by executing the Gradle dependencies task), this is a bug that should be fixed in Allure.

[cb-barathi]

Hi baev, using the following versions:
io.qameta.allure:allure-cucumber7-jvm - "2.29.1"
not using io.qameta.allure:allure-testng instead using io.cucumber:cucumber-testng:7.10.0

I’m observing the following issue with the Gradle task mentioned above: the last test is being removed from the Allure report after the task runs. This is causing the final scenario in my test suite to be excluded from the report. any idea on how to resolve this?

[baev]

Could you please provide an example repository to reproduce the problem? You can use our cucumberjvm-testng example as a baseline.

[cb-barathi]

@baev - The last test run results.json file contains both cucumber and testng results in the same json. is this a bug?

[cb-barathi]

@baev - By setting autoconfigure to true and updating the Allure version to 2.29.1 (as mentioned here), the last test run getting removed from Allure report is resolved and the report displays only Cucumber-based test results. thank you.

[StincyAnshu]

Is it possible to use autoconfigure with maven?

[rahulwarkhedkaradmin]

@baev I am also facing same issue, but I am using maven with below required details -

<allure.version>2.13.2</allure.version>
<cucumber.version>5.6.0</cucumber.version>
<testng.version>6.14.3</testng.version>

	How can i resolve these issue with allure version 2.29.1