roslyn icon indicating copy to clipboard operation
roslyn copied to clipboard

[Flaky test] GoToImplementationOpensProvisionalTabIfDocumentNotOpen

Open allisonchou opened this issue 3 years ago • 2 comments

Example build: https://dev.azure.com/dnceng/public/_build/results?buildId=1650954 Example message:

Assert.Equal() Failure ↓ (pos 0) Expected: FileImplementation.cs Actual: 'IBar' implementations - Entire solution ↑ (pos 0)

Actual and expected values differ. Expected shown in baseline of diff: -: class Implementation : IBar +: The symbol has no implementations. Expected: True Actual: False

System.MissingMethodException : Method not found: 'Microsoft.VisualStudio.Threading.JoinableTaskContext Microsoft.VisualStudio.Shell.ThreadHelper.get_JoinableTaskContext()'.

Runfo Tracking Issue: [Roslyn][Flaky test] GoToImplementationOpensProvisionalTabIfDocumentNotOpen

Build Definition Kind Run Name
1927306 roslyn-integration-CI PR 62670 1-Integration Debug OOP64_true OOPCoreClr_false
1927306 roslyn-integration-CI PR 62670 1-Integration Debug OOP64_true OOPCoreClr_false
1917145 roslyn-integration-CI PR 63116 1-Integration Debug OOP64_true OOPCoreClr_false
1917145 roslyn-integration-CI PR 63116 1-Integration Debug OOP64_true OOPCoreClr_false
1917145 roslyn-integration-CI PR 63116 1-Integration Debug OOP64_true OOPCoreClr_false
1916260 roslyn-integration-CI PR 63116 1-Integration Debug OOP64_true OOPCoreClr_false
1916260 roslyn-integration-CI PR 63116 1-Integration Debug OOP64_true OOPCoreClr_false
1916260 roslyn-integration-CI PR 63116 1-Integration Debug OOP64_true OOPCoreClr_false
1911846 roslyn-integration-CI Rolling 1-Integration Debug OOP64_true OOPCoreClr_false
1911846 roslyn-integration-CI Rolling 1-Integration Debug OOP64_true OOPCoreClr_false
1911846 roslyn-integration-CI Rolling 1-Integration Debug OOP64_true OOPCoreClr_false
1907947 roslyn-integration-CI Rolling 1-Integration Debug OOP64_true OOPCoreClr_false
1907947 roslyn-integration-CI Rolling 1-Integration Debug OOP64_true OOPCoreClr_false
1907947 roslyn-integration-CI Rolling 1-Integration Debug OOP64_true OOPCoreClr_false
1907491 roslyn-integration-CI Rolling 1-Integration Debug OOP64_true OOPCoreClr_false
1907491 roslyn-integration-CI Rolling 1-Integration Debug OOP64_true OOPCoreClr_false
1907491 roslyn-integration-CI Rolling 1-Integration Debug OOP64_true OOPCoreClr_false
1906087 roslyn-integration-CI PR 62970 1-Integration Debug OOP64_true OOPCoreClr_false
1906087 roslyn-integration-CI PR 62970 1-Integration Debug OOP64_true OOPCoreClr_false
1906087 roslyn-integration-CI PR 62970 1-Integration Debug OOP64_true OOPCoreClr_false
1905777 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1905777 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1905777 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1905777 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1905777 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1905777 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1905439 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1905439 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1905439 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1905439 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1905439 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1905439 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1903287 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1903287 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1903287 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1903287 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1903287 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1903287 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1903014 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1903014 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1903014 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1903014 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1903014 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1903014 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1902621 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1902621 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1902621 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1902621 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1902621 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1902621 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1902006 roslyn-integration-CI PR 62653 1-Integration Debug OOP64_true OOPCoreClr_false
1902006 roslyn-integration-CI PR 62653 1-Integration Debug OOP64_true OOPCoreClr_false
1902006 roslyn-integration-CI PR 62653 1-Integration Debug OOP64_true OOPCoreClr_false
1898242 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1898242 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1898242 roslyn-integration-CI PR 62840 1-Integration Debug OOP64_true OOPCoreClr_false
1898242 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1898242 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1898242 roslyn-integration-CI PR 62840 1-Integration Release OOP64_false OOPCoreClr_false
1896436 roslyn-integration-CI PR 62845 1-Integration Release OOP64_false OOPCoreClr_false
1896436 roslyn-integration-CI PR 62845 1-Integration Release OOP64_false OOPCoreClr_false
1896436 roslyn-integration-CI PR 62845 1-Integration Release OOP64_false OOPCoreClr_false
1880575 roslyn-integration-CI PR 62597 1-Integration Release OOP64_false OOPCoreClr_false
1880575 roslyn-integration-CI PR 62597 1-Integration Release OOP64_false OOPCoreClr_false
1880575 roslyn-integration-CI PR 62597 1-Integration Release OOP64_false OOPCoreClr_false

Build Result Summary

Day Hit Count Week Hit Count Month Hit Count
0 1 16

allisonchou avatar Mar 09 '22 22:03 allisonchou

This was likely fixed by #59956

sharwell avatar Mar 09 '22 23:03 sharwell

@allisonchou can you filter out all failures that occurred prior to #59956 merging, or somehow track builds that fail after the fix?

sharwell avatar Mar 10 '22 19:03 sharwell

@sharwell Oops, didn't see your comment until now. It looks like we're still hitting failures as of this month, so seems there's still an issue here.

allisonchou avatar Sep 07 '22 08:09 allisonchou

@allisonchou The recent failures are completely unrelated to the test (the VSIX didn't install, so the test didn't even start). I previously filed https://github.com/microsoft/vs-extension-testing/issues/124 to address the underlying difficulty of triaging this type of failure.

sharwell avatar Sep 07 '22 14:09 sharwell

Gotcha, thanks for taking a look. Will close this particular issue then since it seems to be resolved.

allisonchou avatar Sep 07 '22 19:09 allisonchou