AgentBaker icon indicating copy to clipboard operation
AgentBaker copied to clipboard

perf: Parallelize downloadContainerdWasmShims function / fix download error bug

Open zachary-bailey opened this issue 1 year ago • 4 comments

What type of PR is this?

/kind performance

What this PR does / why we need it:

This PR changes the execution of downloadContainerdWasmShims to make use of parallel processing. It increases the speed of the function by 2 minutes on average.

Which issue(s) this PR fixes:

This is one of a variety of incremental performance improvements that will ultimately increase the speed of VHD Build times.

Requirements:

zachary-bailey avatar Feb 29 '24 19:02 zachary-bailey

Pull Request Test Coverage Report for Build 8653558851

Details

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage remained the same at 79.266%

Totals Coverage Status
Change from base Build 8652187564: 0.0%
Covered Lines: 2355
Relevant Lines: 2971

💛 - Coveralls

coveralls avatar Feb 29 '24 19:02 coveralls

@Mossaka Good morning,

I am the engineer working with @ganeshkumarashok to decrease VHD build times in our pipelines.

Can you review this PR and let me know what you think? I removed v0-3-0 and v0-5-1 in baker.go, baker_test.go, and the cse_install.sh file. This is meant to be a fix until the appropriate versions can be put in. Additionally, I am running the downloadContainerdWasmShims function in parallel now in order to increase speed. It passed in the VHD Build Test pipeline with no errors.

The way the function and configs are currently written, the function fails for 5 minutes while it attempts to download wws-shims for v0-3-0 and v0-5-1. Please let me know if you have an input or suggestions! Thanks.

zachary-bailey avatar Mar 13 '24 17:03 zachary-bailey

Also @zachary-bailey, could you change the PR title to mention the deletion of the older version too, if you decide to keep both deletion and parallelization in the same PR?

ganeshkumarashok avatar Mar 13 '24 19:03 ganeshkumarashok

Agentbaker e2e docs for testing further: https://github.com/Azure/AgentBaker/tree/master/e2e

ganeshkumarashok avatar Mar 29 '24 22:03 ganeshkumarashok