cloudstack icon indicating copy to clipboard operation
cloudstack copied to clipboard

Consider secondary storage selectors during cold volume migration

Open winterhazel opened this issue 6 months ago • 13 comments

Description

The secondary storage selectors allow operators to specify, for instance, that volumes should go to a specific secondary storage A. Thus, when uploading a volume, it will always be downloaded to secondary storage A.

The cold volume migration moves volumes to a secondary storage before moving them to the destination primary storage. This process does not consider the secondary storage selectors. However, some companies want to dedicate specific secondary storages for cold migration.

To address this, this PR makes the cold volume migration process consider the secondary storage selectors.

Types of changes

  • [ ] Breaking change (fix or feature that would cause existing functionality to change)
  • [ ] New feature (non-breaking change which adds functionality)
  • [ ] Bug fix (non-breaking change which fixes an issue)
  • [X] Enhancement (improves an existing feature and functionality)
  • [ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

  • [ ] Major
  • [X] Minor

How Has This Been Tested?

  1. Without any secondary storage selector, I began the cold migration of a volume. I validated that the most free secondary storage was used for migration.

  2. I created a secondary storage selector directing volumes to a specific secondary storage, and began the cold migration of another volume. I validated that the specified secondary storage was used for the migration.

winterhazel avatar Jun 04 '25 17:06 winterhazel

@blueorangutan package

winterhazel avatar Jun 04 '25 17:06 winterhazel

@winterhazel a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan avatar Jun 04 '25 18:06 blueorangutan

Codecov Report

:x: Patch coverage is 61.53846% with 5 lines in your changes missing coverage. Please review. :white_check_mark: Project coverage is 16.14%. Comparing base (823080c) to head (7071461). :warning: Report is 205 commits behind head on 4.20.

Files with missing lines Patch % Lines
...tack/storage/motion/AncientDataMotionStrategy.java 0.00% 5 Missing :warning:
Additional details and impacted files
@@             Coverage Diff              @@
##               4.20   #10957      +/-   ##
============================================
- Coverage     16.14%   16.14%   -0.01%     
- Complexity    13253    13255       +2     
============================================
  Files          5656     5656              
  Lines        497893   497897       +4     
  Branches      60374    60375       +1     
============================================
- Hits          80405    80401       -4     
- Misses       408529   408536       +7     
- Partials       8959     8960       +1     
Flag Coverage Δ
uitests 4.00% <ø> (ø)
unittests 16.99% <61.53%> (-0.01%) :arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • :package: JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

codecov[bot] avatar Jun 04 '25 18:06 codecov[bot]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 13604

blueorangutan avatar Jun 04 '25 19:06 blueorangutan

@blueorangutan package

weizhouapache avatar Sep 11 '25 10:09 weizhouapache

@weizhouapache a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan avatar Sep 11 '25 10:09 blueorangutan

Packaging result [SF]: ✖️ el8 ✖️ el9 ✔️ debian ✖️ suse15. SL-JID 14956

blueorangutan avatar Sep 11 '25 13:09 blueorangutan

@blueorangutan package

weizhouapache avatar Sep 11 '25 18:09 weizhouapache

@weizhouapache a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan avatar Sep 11 '25 18:09 blueorangutan

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 14969

blueorangutan avatar Sep 11 '25 19:09 blueorangutan

@blueorangutan package

DaanHoogland avatar Dec 12 '25 10:12 DaanHoogland

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan avatar Dec 12 '25 10:12 blueorangutan

@winterhazel , is this still relevant for you? (do we need to push through on this?)

DaanHoogland avatar Dec 12 '25 10:12 DaanHoogland

@winterhazel , is this still relevant for you? (do we need to push through on this?)

@DaanHoogland yup, still relevant. Would be nice having this one merged.

winterhazel avatar Dec 12 '25 11:12 winterhazel

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✖️ debian ✔️ suse15. SL-JID 16022

blueorangutan avatar Dec 12 '25 12:12 blueorangutan

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 16029

blueorangutan avatar Dec 12 '25 14:12 blueorangutan