[v2.9] Add support for rotating worker nodes after creating an etcd snapshot

[markusewalker]

Issue: Automate rotating nodes after creating an etcd snapshot

Problem

As part of ongoing additional etcd snapshot coverage, one test case we manually check is rotating nodes after creating an etcd shapshot. This quickly becomes a pain manually, so it should be automated.

Solution

Adds support for rotating worker nodes after creating an etcd snapshot. Additionally, gives needed stability in flakiness found during release testing in the snapshot tests.

Testing

Engineering Testing

Manual Testing

• K3S (3 etcd, 2 cp, 3 worker) DynamcInput with upgrade strategy
• K3S (1 etcd, 1 cp, 1 worker) DynamcInput with upgrade strategy
• RKE1 (3 etcd, 2 cp, 3 worker) DynamcInput with upgrade strategy

Automated Testing

Jenkins jobs will be provided offline to the reviewers.