Test Reporting data discrepancies

Using this query, it appears that we’re not collecting any passing data for this particular test in ASPNETCore:

let start = 30d;                   // Timespan value
let end = 10d;                     // Timespan value
let repo = "dotnet/aspnetcore";    // Optional: set to empty string if you want results from all repositories
let testName="Microsoft.AspNetCore.Mvc.FunctionalTests.SimpleWithWebApplicationBuilderTests.DefaultEnvironment_Is_Development";
AzureDevOpsTestsSummary
| where ReportDate >= ago(start) and ReportDate <= ago(end) and iff(repo == "", Repository == Repository, Repository == repo) and TestName == testName

However, looking at this report on Azure DevOps, it appears that the test has passed, and should be showing up in the data we’re collecting: https://dev.azure.com/dnceng/public/_test/analytics?definitionId=278&contextType=build

We need to investigate why the passing test values are not being aggregated in our results.

[dougbu]

Thanks @missymessa 👀

[ChadNedzlek]

I believe @dougbu’s guess is correct. We should start accumulating data at that point. We’ll need to make sure our service handles the scale correctly, but it won’t retroactively reach back in time much. There’s about a day where the data will stabilize because of aggregations and what not, so after a day, stuff should be complete going forward.