FixAllOccurrencesIgnoresGeneratedCode is flaky

[Cosifne]

Example build: https://dev.azure.com/dnceng/public/_build/results?buildId=1653816&view=results Example error messages:

System.Exception : No light bulb session in View! Buffer content type=CSharp

System.MissingMethodException : Method not found: 'Microsoft.VisualStudio.Threading.JoinableTaskContext Microsoft.VisualStudio.Shell.ThreadHelper.get_JoinableTaskContext()'.

Runfo Tracking Issue: [Roslyn][Flaky test] CSharp.CSharpCodeActions.FixAllOccurrencesIgnoresGeneratedCode

Build	Definition	Kind	Run Name
568860	roslyn-integration-CI	PR 72115	1-Integration Debug OOP64_True OOPCoreClr_False
568860	roslyn-integration-CI	PR 72115	1-Integration Debug OOP64_True OOPCoreClr_False
568860	roslyn-integration-CI	PR 72115	1-Integration Debug OOP64_True OOPCoreClr_False
568573	roslyn-integration-CI	PR 62771	1-Integration Debug OOP64_True OOPCoreClr_False
568573	roslyn-integration-CI	PR 62771	1-Integration Debug OOP64_True OOPCoreClr_False
568573	roslyn-integration-CI	PR 62771	1-Integration Debug OOP64_True OOPCoreClr_False
568573	roslyn-integration-CI	PR 62771	1-Integration Release OOP64_False OOPCoreClr_False
568573	roslyn-integration-CI	PR 62771	1-Integration Release OOP64_False OOPCoreClr_False
568573	roslyn-integration-CI	PR 62771	1-Integration Release OOP64_False OOPCoreClr_False
568272	roslyn-integration-CI	Rolling	1-Integration Release OOP64_True OOPCoreClr_False
568272	roslyn-integration-CI	Rolling	1-Integration Release OOP64_True OOPCoreClr_False
568272	roslyn-integration-CI	Rolling	1-Integration Release OOP64_True OOPCoreClr_False
567970	roslyn-integration-CI	Rolling	1-Integration Release OOP64_True OOPCoreClr_False
567970	roslyn-integration-CI	Rolling	1-Integration Release OOP64_True OOPCoreClr_False
567970	roslyn-integration-CI	Rolling	1-Integration Release OOP64_True OOPCoreClr_False
567215	roslyn-integration-CI	PR 71916	1-Integration Debug OOP64_True OOPCoreClr_False
567215	roslyn-integration-CI	PR 71916	1-Integration Debug OOP64_True OOPCoreClr_False
567215	roslyn-integration-CI	PR 71916	1-Integration Debug OOP64_True OOPCoreClr_False
567062	roslyn-integration-CI	Rolling	1-Integration Release OOP64_True OOPCoreClr_False
567062	roslyn-integration-CI	Rolling	1-Integration Release OOP64_True OOPCoreClr_False
567062	roslyn-integration-CI	Rolling	1-Integration Release OOP64_True OOPCoreClr_False
567062	roslyn-integration-CI	Rolling	1-Integration Release OOP64_False OOPCoreClr_False
567062	roslyn-integration-CI	Rolling	1-Integration Release OOP64_False OOPCoreClr_False
567062	roslyn-integration-CI	Rolling	1-Integration Release OOP64_False OOPCoreClr_False
566896	roslyn-integration-CI	Rolling	1-Integration Release OOP64_True OOPCoreClr_False
566896	roslyn-integration-CI	Rolling	1-Integration Release OOP64_True OOPCoreClr_False
566896	roslyn-integration-CI	Rolling	1-Integration Release OOP64_True OOPCoreClr_False
566896	roslyn-integration-CI	Rolling	1-Integration Release OOP64_False OOPCoreClr_False
566896	roslyn-integration-CI	Rolling	1-Integration Release OOP64_False OOPCoreClr_False
566896	roslyn-integration-CI	Rolling	1-Integration Release OOP64_False OOPCoreClr_False
566796	roslyn-integration-CI	PR 72106	1-Integration Debug OOP64_True OOPCoreClr_False
566796	roslyn-integration-CI	PR 72106	1-Integration Debug OOP64_True OOPCoreClr_False
566796	roslyn-integration-CI	PR 72106	1-Integration Debug OOP64_True OOPCoreClr_False
566498	roslyn-integration-CI	PR 72090	1-Integration Debug OOP64_True OOPCoreClr_False
566498	roslyn-integration-CI	PR 72090	1-Integration Debug OOP64_True OOPCoreClr_False
566498	roslyn-integration-CI	PR 72090	1-Integration Debug OOP64_True OOPCoreClr_False
564597	roslyn-integration-CI	PR 71869	1-Integration Debug OOP64_True OOPCoreClr_False
564597	roslyn-integration-CI	PR 71869	1-Integration Debug OOP64_True OOPCoreClr_False
564597	roslyn-integration-CI	PR 71869	1-Integration Debug OOP64_True OOPCoreClr_False
563382	roslyn-integration-CI	PR 62741	1-Integration Debug OOP64_True OOPCoreClr_False
563382	roslyn-integration-CI	PR 62741	1-Integration Debug OOP64_True OOPCoreClr_False
563382	roslyn-integration-CI	PR 62741	1-Integration Debug OOP64_True OOPCoreClr_False

Build Result Summary

Day Hit Count	Week Hit Count	Month Hit Count
0	0	11

[sharwell]

Probable cause is integration tests are not waiting for async light bulb to show all items

[CyrusNajmabadi]

@sharwell same question. Do you still think this is async lightbulbs? And, if so, are yous till seeing this?

[sharwell]

I'm not sure on the status of this one

[allisonchou]

This test is still flaky; updating the RunFo query momentarily to reflect this.

[allisonchou]

@CyrusNajmabadi @sharwell we're still seeing this issue in newer builds. Is this an issue with async lightbulbs?

[sharwell]

@allisonchou Yes, this is known. It should be fixed by #60048 , but that is blocked on some other prerequisites.

[jcouv]

Assigned to @sharwell since he seems to be working on a fix. Thanks