Failed to publish artifact

[ulisesh]

Build

https://dev.azure.com/dnceng/public/_build/results?buildId=1711221

Build leg reported

CoreCLR Product Build OSX x64 checked

Pull Request

No response

Action required for the engineering services team

To triage this issue (First Responder / @dotnet/dnceng):

• [ ] Open the failing build above and investigate
• [ ] Add a comment explaining your findings

If this is an issue that is causing build breaks across multiple builds and would get benefit from being listed on the build analysis check, follow the next steps:

1. Add the label "Known Build Error"
2. Edit this issue and add an error string in the Json below that can help us match this issue with future build breaks. You should use the known issues documentation

{
   "ErrorMessage" : "[error]File upload failed even after retry."
}

Additional information about the issue reported

No response

Report

Build	Definition	Step Name	Console log
1938183	dotnet/sdk	Build	Log
1936649	dotnet/sdk	Build	Log
1934322	dotnet/sdk	Build	Log
1934328	dotnet/sdk	Build	Log
1931063	dotnet/sdk	Build	Log
1928464	dotnet/sdk	Build	Log
1929135	dotnet/sdk	Build	Log
1929272	dotnet/sdk	Build	Log
1929459	dotnet/sdk	Build	Log
1929933	dotnet/sdk	Build	Log
1929872	dotnet/sdk	Build	Log
1931054	dotnet/sdk	Build	Log
1932373	dotnet/sdk	Build	Log
1932768	dotnet/sdk	Build	Log
1933667	dotnet/sdk	Build	Log
1933739	dotnet/sdk	Build	Log
1933853	dotnet/sdk	Build	Log
1934384	dotnet/sdk	Build	Log
1934391	dotnet/sdk	Build	Log
1934445	dotnet/sdk	Build	Log
1934518	dotnet/sdk	Build	Log
1934729	dotnet/sdk	Build	Log
1934978	dotnet/sdk	Build	Log
1935859	dotnet/sdk	Build	Log
1936020	dotnet/sdk	Build	Log
1936085	dotnet/sdk	Build	Log
1936153	dotnet/sdk	Build	Log
1936282	dotnet/sdk	Build	Log
1938493	dotnet/sdk	Build	Log
1938587	dotnet/sdk	Build	Log
1938986	dotnet/sdk	Build	Log
1939251	dotnet/sdk	Build	Log
1939435	dotnet/sdk	Build	Log
1939464	dotnet/sdk	Build	Log
1939380	dotnet/sdk	Build	Log
1910467	dotnet/sdk	Build	Log
1906511	dotnet/sdk	Build	Log
1901798	dotnet/sdk	Build	Log
1903259	dotnet/sdk	Build	Log
1903474	dotnet/sdk	Build	Log
1903530	dotnet/sdk	Build	Log
1905140	dotnet/sdk	Build	Log
1905478	dotnet/sdk	Build	Log
1905990	dotnet/sdk	Build	Log
1907388	dotnet/sdk	Build	Log
1907909	dotnet/sdk	Build	Log
1910673	dotnet/runtime	Build OSX x64 release Runtime_Release	Log
1898183	dotnet/sdk	Build	Log
1886893	dotnet/sdk	Build	Log
1891366	dotnet/sdk	Build	Log
1892380	dotnet/sdk	Build	Log
1893390	dotnet/sdk	Build	Log
1894681	dotnet/sdk	Build	Log
1895882	dotnet/sdk	Build	Log
1897341	dotnet/sdk	Build	Log
1899055	dotnet/sdk	Build	Log
1899590	dotnet/sdk	Build	Log
1899602	dotnet/sdk	Build	Log
1899971	dotnet/sdk	Build	Log
1927547	dotnet/sdk	Build	Log
1927564	dotnet/sdk	Build	Log
1917449	dotnet/sdk	Build	Log
1914993	dotnet/sdk	Build	Log
1923614	dotnet/sdk	Build	Log
1925858	dotnet/sdk	Build	Log
1925898	dotnet/sdk	Build	Log
1926325	dotnet/sdk	Build	Log
1926576	dotnet/sdk	Build	Log
1927153	dotnet/sdk	Build	Log
1927715	dotnet/sdk	Build	Log
1880647	dotnet/runtime	Publish Test Assets	Log
1883038	dotnet/sdk	Build	Log
1883086	dotnet/sdk	Build	Log

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
8	40	73

[epananth]

Created ICM https://portal.microsofticm.com/imp/v3/incidents/details/311836761/home

[ilyas1974]

Work item created by team - https://mseng.visualstudio.com/AzureDevOps/_workitems/edit/1971465

[ilyas1974]

Currently being worked on.

[Tarrasse]

• Each pipeline run maps to a file container in ADO
• File container has a tree of files in a file system like structure
• Each file is identified by its path/name

The problem here is that, this pipeline had multiple jobs, all of them are generating the same file and uploading it. Occasionally two jobs would catch up to each other and upload the same file concurrently, that would result in this issue

you can see from the logs of this pipeline, that stages Ubuntu_20_04_TemplateEngine and Ubuntu_20_04 was uploading the file named BlobArtifacts/dotnet-toolset-internal-7.0.100-ci.zip at the same time.

[mmitche]

• Each pipeline runs maps to a file container in ADO
• File container has a tree of files in a file system like structure
• Each file is identified by its path/name

The problem here is that this pipeline had multiple jobs, all of them were generating the same file and uploading it. Occasionally two jobs would catch up to each other and upload the same file concurrently, that would result in this issue

you can see from the logs of this pipeline, that stages Ubuntu_20_04_TemplateEngine and Ubuntu_20_04 was uploading the file named at the same time BlobArtifacts/dotnet-toolset-internal-7.0.100-ci.zip

This is correct. Think this may have been fixed in the past but regressed. Only one of the SDK's PR jobs should pass -publish