question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

It is impossible to use Matrix Testing with different frameworks

See original GitHub issue

I have to test multitargeted library with frameworks matrix, but it is impossible to map target framework to dotnet-version.

For example, I have workflow:

strategy:
  fail-fast: false
  matrix:
    framework: [net48, netcoreapp2.1, netcoreapp3.1, net5.0, net6.0]

steps:
- name: Install .NET
  uses: actions/setup-dotnet@main
  with:
    dotnet-version: ???
  
- name: Test
  run: dotnet test <my project> --framework ${{ matrix.framework }}

and want to install only dotnet 2.1.x for netcoreapp2.1 target, dotnet 5.0.x for net5.0 target and so on.

Also, it seems that installing only dotnet 6.0.x is not enough to run tests under net5.0.

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:7

github_iconTop GitHub Comments

1reaction
KungAcommented, Nov 22, 2021

Ok, it is not too important to me, and I’ll use huge syntax with conditionals.

1reaction
kzrnmcommented, Nov 21, 2021

Since you are targeting 5 frameworks, I think it is natural that your tests take 5x times longer.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Most Popular Test Automation Frameworks with Pros and ...
In this Selenium tutorial we will focus on different Test Automation Frameworks, types, benefits of using a framework and the basic ...
Read more >
Advanced Topic - Agile Testing - Scaled Agile Framework
The agile testing matrix provides a taxonomy for organizing these types of tests. This approach was further developed in Agile Testing [2] ...
Read more >
The Testing Pyramid: How to Structure Your Test Suite
Explore different ways of organizing the test suite including testing pyramid, testing matrix and testing trophy.
Read more >
Agile Testing Quadrants - TestProject
The agile testing quadrants are a visual tool that can help you decide what types of testing to focus on. Let's learn how...
Read more >
Risk Based Testing: Approach, Matrix, Process & Examples
Different test design techniques can be used for e.g. using the decision table ... at frequency of use and at the possible cost...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found