Regression: @Ignore on method level doesn't work as expected

[youming-lin]

Regression: @Ignore on method level doesn't work as expected

[krmahadevan]

@youming-lin - This seems to be a problem specific to TestNG eclipse plugin perhaps?

Can you please run the below sample and tell me what you see? I dont see issue that you are experiencing.

import org.testng.IInvokedMethod;
import org.testng.IInvokedMethodListener;
import org.testng.ITestResult;
import org.testng.TestNG;
import java.util.ArrayList;
import java.util.List;

import static org.assertj.core.api.Assertions.assertThat;

public class IssueMain {

  public static void main(String[] args) {
    TestNG testng = new TestNG(false);
    testng.setTestClasses(new Class[]{TestNGEclipseIgnoreBugSample.class});
    InvokedMethodListener listener = new InvokedMethodListener();
    testng.addListener(listener);
    testng.run();
    assertThat(listener.invokedMethods).isEmpty();
  }

  public static class InvokedMethodListener implements IInvokedMethodListener {
    final List<String> invokedMethods = new ArrayList<>();

    @Override
    public void beforeInvocation(IInvokedMethod method, ITestResult testResult) {
      invokedMethods.add(method.getTestMethod().getMethodName());
    }
  }
}

If the problem still exists when running via eclipse, then you should perhaps file this issue on https://github.com/testng-team/testng-eclipse

@missedone - FYI

[youming-lin]

@krmahadevan Thanks for checking!
I created a new project with just this test class and cannot reproduce this any more (neither running mvn test nor through TestNG Eclipse plugin). Not sure what is going with the original project's configuration.

[ramtech123]

I have same issue with @ignore annotation, individual tests are disabled only when using enabled = false.

• Gradle 7.6,
• Verified with different versions of testng
  -- 7.5.1 and 7.8.0 - @Ignore annotation at method level is not working in both cases
  -- 7.4.0 - @Ignore annotation disables the test, as expected.

(PS: not using eclipse)

Was there any issue / resolution that was identified? Thanks

[krmahadevan]

@ramtech123 - Please share a sample project that can be used to reproduce the problem

[ramtech123]

It is working fine with a plain vanilla gradle project. Need to figure out the difference with my main project as the latter has some additional configurations. Will try to get a reproducer in a few days. Thanks.