GCSStore Lifecycle

[OrlandoCo]

Is there a way to set expiration headers to chunks in GCS store?, or someone knows how to deal with unfinished uploads?

[Acconut]

Apologies for the late reply, I list this ticket from my radar somehow. There is no native support for expiration inside GCSStore (yet), however, you might be able to configure expiration rules directly inside Google Cloud Storage. At least AWS S3 offers such a feature.

[OrlandoCo]

The las time I used the GCSStorage, it created chunks and then merged them, but doesn't use the native resumable-upload from GCS . the native method have the "disadvantage" that expires the resumable link after 1 week.

GCS supports lifecycle for files, but not the same way AWS does for multipart files.

So maybe the solution can be to add the lifecycle rule after chunk is uploaded.

[Acconut]

The las time I used the GCSStorage, it created chunks and then merged them, but doesn't use the native resumable-upload from GCS .

That's correct, this mechanism also hasn't changed in the meantime.

So maybe the solution can be to add the lifecycle rule after chunk is uploaded.

Good idea, we would be open for a PR if someone wants to work on this feature.