dotnet test fails to find system.runtime with netcoreapp

Steps to reproduce

1. Create a test project that targets netcoreapp1.0
2. dotnet restore --infer-runtimes
3. dotnet test

project.json

{
  "dependencies": {
    "NuGet.Versioning": {
      "target": "project"
    },
    "xunit": "2.1.0"
  },
  "frameworks": {
    "netcoreapp1.0": {
      "imports": [
        "netstandardapp1.5",
        "dnxcore50",
        "portable-net45+win8"
      ],
      "dependencies": {
        "dotnet-test-xunit": "1.0.0-dev-140469-38",
        "Microsoft.NETCore.App": {
          "version": "1.0.0-rc2-3002339"
        }
      }
    },
    "net46": {
      "frameworkAssemblies": {
        "Microsoft.CSharp": "",
        "System": "",
        "System.Core": "",
        "System.Runtime": "",
        "System.Threading.Tasks": ""
      }
    }
  },
  "testRunner": "xunit"
}

Expected behavior

Tests will run

Actual behavior

Unhandled Exception: System.IO.FileNotFoundException: Could not load file or assembly 'System.Runtime, Version=4.1.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies.

Environment data

dotnet --info output:

.NET Command Line Tools (1.0.0-rc2-002339)

Product Information:
 Version:     1.0.0-rc2-002339
 Commit Sha:  2be5e84f87

Runtime Environment:
 OS Name:     Windows
 OS Version:  10.0.10586
 OS Platform: Windows
 RID:         win10-x64

@pakrym helped debug this. Without --runtimeconfig tests run.

Trace:

C:\src\NuGet.Client\cli\shared\Microsoft.NETCore.App\1.0.0-rc2-3002339\corehost.exe : Tracing enabled
At line:1 char:2
+  C:\src\NuGet.Client\cli\shared\Microsoft.NETCore.App\1.0.0-rc2-30023 ...
+  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (Tracing enabled:String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError


--- Invoked policy [Microsoft.NETCore.DotNetHostPolicy/1.0.1-rc2-002339/runtimes/win7-x64/native] main = {
C:\src\NuGet.Client\cli\shared\Microsoft.NETCore.App\1.0.0-rc2-3002339\corehost.exe
C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5\dotnet-test-xunit.dll
--runtimeconfig
C:\src\NuGet.Client\test\NuGet.Core.Tests\NuGet.Versioning.Test\bin\Debug\netcoreapp1.0\win7-x64\NuGet.Versioning.Test.runtimeconfig.json
--depsfile
C:\src\NuGet.Client\test\NuGet.Core.Tests\NuGet.Versioning.Test\bin\Debug\netcoreapp1.0\win7-x64\NuGet.Versioning.Test.deps.json
--additionalprobingpath
C:\Users\juste\.nuget\packages
C:\src\NuGet.Client\test\NuGet.Core.Tests\NuGet.Versioning.Test\bin\Debug\netcoreapp1.0\NuGet.Versioning.Test.dll
}
Host mode: 3
Deps file: 
-- arguments_t: own_path=C:\src\NuGet.Client\cli\shared\Microsoft.NETCore.App\1.0.0-rc2-3002339\corehost.exe app_dir=C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5 
deps=C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5\dotnet-test-xunit.deps.json extensions=C:\Program Files (x86)\dotnetextensions packages_cache= 
mgd_app=C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5\dotnet-test-xunit.dll
Runtime config is cfg=C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5\dotnet-test-xunit.runtimeconfig.json 
dev=C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5\dotnet-test-xunit.runtimeconfig.dev.json
Attempting to read runtime config: C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5\dotnet-test-xunit.runtimeconfig.json
Attempting to read dev runtime config: C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5\dotnet-test-xunit.runtimeconfig.dev.json
Runtime config [C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5\dotnet-test-xunit.runtimeconfig.json] is valid=[1]
Deps file does not exist [C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5\dotnet-test-xunit.deps.json]
-- Listing probe configurations...
probe_config_t: probe=[C:\src\NuGet.Client\cli\shared\Microsoft.NETCore.App\1.0.0-rc2-3002339] match-hash=[0] patch-roll-forward=[0] prerelease-roll-forward=[0] deps-json=[0000000000000000]
-- Starting CoreCLR Probe from app deps.json
Deps has no coreclr entry.
Probing for CoreCLR in deps directory=[C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5]
Checking if CoreCLR path exists=[C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5\coreclr.dll]
Checking if CoreCLR path exists=[C:\Users\juste\AppData\Local\dotnet\runtime\coreclr\coreclr.dll]
Checking if CoreCLR path exists=[C:\Program Files\dotnet\bin\coreclr.dll]
CoreCLR directory: C:\Program Files\dotnet\bin
Adding files from local dir C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5
Adding dotnet-test-xunit to local assembly set from C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5\dotnet-test-xunit.dll
Adding tpa entry: C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5\dotnet-test-xunit.dll
Adding to native path: C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5
Adding to native path: C:\src\NuGet.Client\cli\shared\Microsoft.NETCore.App\1.0.0-rc2-3002339
Adding to native path: C:\Program Files\dotnet\bin
Adding to resources path: C:\Users\juste\.nuget\packages\dotnet-test-xunit\1.0.0-dev-140469-38\lib\netstandard1.5
Adding to resources path: C:\src\NuGet.Client\cli\shared\Microsoft.NETCore.App\1.0.0-rc2-3002339
Adding to resources path: C:\Program Files\dotnet\bin
Setting PATH=D:\tools\ConEmuPack\ConEmu\Scripts;D:\tools\ConEmuPack;D:\tools\ConEmuPack\ConEmu;C:\ProgramDa
ta\Oracle\Java\javapat

Unhandled Exception:

System.IO.FileNotFoundException: Could not load file or assembly 'System.Runtime, Version=4.1.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. The system cannot find the file specified.

[brthor]

dotnet/cli#2392 Will fix the --runtimeconfig issue here.

[emgarten]

@eerhardt that could be the cause…