csm icon indicating copy to clipboard operation
csm copied to clipboard

[FEATURE]: New data migration component

Open seanzhan2014 opened this issue 1 year ago • 1 comments

Describe the solution you'd like When user bought our storage to replace their existing storage (such as ODF), we need to provide a tool for them to migrate the pv/pvc and data. Without this tool, users have to do a lot of manual work. Take PowerScale as an example:

  1. Copy all data from existing storage to new PowerScale.
  2. Create one or multple PowerScale storageclass in Kubernetes.
  3. Create NFS exports one by one.
  4. Create static PV/PVC one by one. Such process is time consuming. During this phase, applications will be affected.

I expect we can have a tool to automate this migration:

  1. Users can create PowerScale storageclass, and defined existing PV/PVCs to be migrate, (can be namespace based, i.e. I'd like to migrate all PV/PVCs under this namespace. Or can be storageclass based. The condition should be flexible enough for users to select the existing PV/PVCs.)
  2. Users also need to define how the PV/PVC need to be migrate. It can be migrate all PV/PVCs in parallel in one time. Or they can migrate certain amount of PV/PVCs in one batch.
  3. Users can stop their applications accordingly, The new tool will then create new PV/PVCs accordingly, and deploy CSM function (Kubernetes deployment) which can mount old and new PV/PVCs.
  4. The new CSM function start to copy the data from existing PV/PVCs to new PV/PVCs.
  5. Users change the PV/PVCs in the application yaml to PowerScale PV/PVCs and relauch the application.

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context Add any other context or screenshots about the feature request here.

seanzhan2014 avatar Jul 06 '23 02:07 seanzhan2014

@seanzhan2014: Thank you for submitting this issue!

The issue is currently awaiting triage. Please make sure you have given us as much context as possible.

If the maintainers determine this is a relevant issue, they will remove the needs-triage label and assign an appropriate priority label.


We want your feedback! If you have any questions or suggestions regarding our contributing process/workflow, please reach out to us at [email protected].

csmbot avatar Jul 06 '23 02:07 csmbot