Using skip feature with XUnit InlineData attribute throws InvalidOperationException

Description

Adding a Skip parameter to XUnit InlineData attribute is throwing the below error:

Message: System.InvalidOperationException : TestOutput is not provided. Ensure that scenario is executed from method with [Scenario] attribute, or ITestOutputHelper instance is provided to FeatureFixture constructor.

Example of Scenario:

public class AdditionFeature: FeatureFixture
{

[InlineData(1,2, 3, Skip = "Skip this scenario because its faulty.")]
[Scenario]
public async Task Scenario_test_one_plus_two(int firstNumber, int secondNumber, int expectedResult) 
=> await Runner.WithContext<TestContext>()
			.AddSteps(
				given => given.Two_numbers_are_inputted.(firstnumber, secondnumber))
			.AddAsyncSteps(
				when => when.The_two_numbers_are_added())
			.AddSteps(
				then => then.The_two_numbers_should_be_EXPECTEDRESULT(expectedResult))
			.RunAsync();
}

Progress

• Feature is implemented,
• Ensured backward-compatibility,
• Ensured good debugging experience
• Wiki page is updated
  • steps behaviour

[Suremaker]

Hello @krt-c ,

Thanks for reporting it. I have to take a look at the details and will come back to you. For the time being pese use [IgnoreScenario()] described here

[Suremaker]

List of changes:

• Updated LightBDD to support Skip property on ScenarioAttribute as well as InlineDataAttribute, allow the test to run but make it ignored as soon as executed with Runner, so that outcome is included in the reports
• Added UseXUnitSkipBehaviorAttribute that could enforce default xunit behavior.

The tests no longer fail when [InlineData] is used with Skip property.

The feature has been tested in:

• VS Test Explorer (VS 2019 16.3.1)
• Resharper
• dotnet test command

---

Assuming the following code:

[Scenario]
[InlineData(2)]
[InlineData(3)]
[InlineData(4, Skip = "Not running it!")]
public void Eating_N_cakes(int n)
{
    var myCakes = 3;
    Runner.RunScenario(
        _ => Given_I_have_N_cakes(myCakes),
        _ => When_I_eat_N_of_them(n),
        _ => Then_I_should_have_N_left(myCakes - n));
}

[Scenario(Skip = "It will just not happen!")]
public void Eating_lemons()
{
    Runner.RunScenario(
        _ => Given_I_have_a_lemon(),
        _ => When_I_eat_it(),
        _ => Then_I_should_have_none());
}

Before the change, the skipped tests were not present in the reports (and [InlineData] with Skip property were causing runtime issues):

With the change, the skipped tests are included in the reports:

Please note that even though the Scenario is marked as Ignored, the test method is effectively executed, especially any code up to Runner.RunScenario(). In case when this behavior is undesired, the native xunit treatment of skipped tests can be restored by adding [assembly: UseXUnitSkipBehavior] to the test project.