Enable Parallelization for Data-Driven Tests

Description

following your documentation here: https://github.com/Microsoft/testfx-docs/blob/master/RFCs/004-In-Assembly-Parallel-Execution.md

did not execute my tests on parallel. furthermore, the Parallelize attribute cannot be found (you do not mention where this attribute is coming from)

Steps to reproduce

complete code:

using System;
using System.Collections.Generic;
using System.Threading;
using Microsoft.VisualStudio.TestTools.UnitTesting;

namespace UnitTestProject1
{
    [TestClass]
    public class UnitTest1
    {
        [DataTestMethod]
        [DynamicData(nameof(GetData), DynamicDataSourceType.Method)]
        public void TestMethod1(int a, int b, int expected)
        {
            Thread.Sleep(10000);
            var actual = a + b;
            Assert.AreEqual(expected, actual);
        }

        [DataTestMethod]
        [DynamicData(nameof(GetData), DynamicDataSourceType.Method)]
        public void TestMethod2(int a, int b, int expected)
        {
            Thread.Sleep(10000);
            var actual = a + b;
            Assert.AreEqual(expected, actual);
        }

        public static IEnumerable<object[]> GetData()
        {
            yield return new object[] { 1, 1, 2 };
            yield return new object[] { 14, 1, 15 };
            yield return new object[] { 12, 30, 42 };
        }
    }
}

Run Settings

<?xml version="1.0" encoding="utf-8"?>
<RunSettings>
  <MSTest>
    <Parallelize>
      <Workers>8</Workers>
      <Scope>MethodLevel</Scope>
    </Parallelize>
  </MSTest>
</RunSettings>

Expected behavior

according to the tutorials, total execution of each test will be around 10 seconds (all iterations in parallel)

Actual behavior

nothing runs in parallel

Environment

windows 10. NuGet Packages: MSTest.TestAdapter (v.1.2.1), MSTest.TestFramework (v1.2.1) Latest vstest.console (latest vs2017)

[sroei]

Sorry for taking me a while. If this is not supported, please close the issue

This is the expected I was aiming for and the initial problem was that I could not run parallel on the iteration level. Running parallel on the test level is relatively easy and I use multiple test agents to achieve that (I have like 100 + Selenium Grid).

An example of the desired expected you can see on TestNG while set it to parallel data-source.

Use Case

1. Data-Driven Test with 250 Iterations
2. Each Iteration Runs for ~30sec

Problem: cannot be distributed around multiple agents nor run in parallel on a single machine.

I will try to open a feature request and hopefully this will be supported in the future - the current workaround (without splitting the data-source) is very ugly

[jayaranigarg]

Closing this thread and using this issue to track the feature request…