buildmaster-config icon indicating copy to clipboard operation
buildmaster-config copied to clipboard

New worker request: <diegorusso-aarch64-bigmem>

Open diegorusso opened this issue 11 months ago • 8 comments

Username

diegorusso

GitHub username

No response

Name

Diego Russo

Email address

[email protected]

Password status

I need a new owner password

Processor architecture

aarch64

Operating System

Ubuntu 22.04

Anything special about the worker?

This machine is an aarch64 Equinix machine and it is currently used to run benchmarks to be uploaded to speed.python.org. Given its spec, we'd like to run also bigmem tests. Tagging @ambv for visibility

diegorusso avatar Mar 08 '24 12:03 diegorusso

Hmm, if it's a benchmark runner, do we really want it running a buildbot as well? It seems that would impact its ability to run benchmarks effectively, or would require routinely stopping the buildbot worker process.

zware avatar Mar 08 '24 16:03 zware

We have set up the machine with cpu isolation. The machine has 80 cores and we have isolated the last 14 cores for running benchmarks: to be precise we run benchmarks just on the odd cores in the range 65-79 (65, 67, 69..) using cpu affinity.

Daily benchmarks are run at midnight (UTC) only, the rest of the time the machine is idle.

The aim is to maximise the use of this machine. If we want to be on the safe side we could pause buildbot jobs 2 hours before and after midnight so it won't be scheduling jobs when benchmarks will be running.

diegorusso avatar Mar 08 '24 17:03 diegorusso

Ok. I'm no expert at benchmarks, so if that configuration is deemed sufficient from that side of things, I'm ok from the buildbot side of things :)

Can you create a PR adding the public configuration? #404 should be a reasonable template to follow, though there may be some extras needed to enable bigmem testing.

zware avatar Mar 08 '24 17:03 zware

@diegorusso I created a new owner password and emailed it to you.

itamaro avatar Mar 10 '24 01:03 itamaro

Related PR: https://github.com/python/buildmaster-config/pull/474

vstinner avatar Mar 10 '24 15:03 vstinner

Thanks @itamaro. I confirmed I received it.

diegorusso avatar Mar 11 '24 13:03 diegorusso

I have my hands blocked until this https://discuss.python.org/t/top-level-license-not-present-on-some-repos/47973 gets resolved.

diegorusso avatar Mar 11 '24 13:03 diegorusso

@ambv were you planning to add license and CLA bot?

itamaro avatar Jun 16 '24 17:06 itamaro

MIT license added as all contributors were reached for acknowledgement and provided it.

ambv avatar Oct 10 '24 20:10 ambv