vck icon indicating copy to clipboard operation
vck copied to clipboard

Sync back with S3 data source.

Open Tomcli opened this issue 7 years ago • 5 comments

If I have my data downloaded/sync from S3 to hostPath, is there a way for me to sync back my changes in the hostPath back to my S3 storage?

Tomcli avatar Jul 09 '18 22:07 Tomcli

@Tomcli We had discussed about this during our offline meeting. Did you have a chance to try out VCK?

balajismaniam avatar Jul 30 '18 16:07 balajismaniam

@balajismaniam Yes, we tried VCK on our Cluster and it works great. However, when we want to sync back some of our modified data in HostPath back to S3, we have to do it manually on the node. So we would love to see if VCK can provide some help on data upload to S3. Also, I'm wondering can the volumemanager create a cronjob to periodically sync with our data on S3.

Tomcli avatar Jul 31 '18 18:07 Tomcli

Thanks for feedback @Tomcli. For the data upload to S3, as a first cut is it fine if we add the following assumption:

  • The data upload to S3 will be added as an option for the S3 source type.
  • If the above option is enabled, only one replica will be allowed.

Do you think the above assumptions will work for your use case?

balajismaniam avatar Jul 31 '18 21:07 balajismaniam

Thank you @balajismaniam, I think that should work for us as a first cut.

Tomcli avatar Aug 01 '18 17:08 Tomcli

@Tomcli We added this feature as discussed above in #72.

balajismaniam avatar Sep 20 '18 22:09 balajismaniam