alluxio icon indicating copy to clipboard operation
alluxio copied to clipboard

Set FREE as the default action when file's ttl is expired

Open DamonFool opened this issue 2 years ago • 8 comments

Hi all,

May I get reviews for this small patch?

What changes are proposed in this pull request?

When file's ttl is expired, the default action performs on it was changed from DELETE to FREE.

Why are the changes needed?

This is because the file may be used again even though the file's ttl is expired. So it seems better to free it instead of deleting it.

Does this PR introduce any user facing changes?

No.

Thanks. Best regards, Jie

DamonFool avatar Aug 01 '22 06:08 DamonFool

Thank you for your pull request. In order for us to evaluate and accept your PR, we ask that you sign a contribution license agreement (CLA). It's all electronic and will take just a few minutes. Please download CLA form here, sign, and e-mail back to [email protected]

alluxio-bot avatar Aug 01 '22 06:08 alluxio-bot

FREE seems to be the safer option here. @HelloHorizon thoughts?

dbw9580 avatar Aug 01 '22 10:08 dbw9580

The TTL in Alluxio is used for a strict access pattern(TTL is disabled by default and should only be enabled by clients which have strict data access patterns.), I don't think we should change the default value in this case.

HelloHorizon avatar Aug 01 '22 20:08 HelloHorizon

@HelloHorizon Not sure some people would set the alluxio.user.file.create.ttl without set xx.action, the result maybe not as expected, the file could be deleted without any conform, so is it would be better if we change the default value to free or do nothing?

maobaolong avatar Aug 02 '22 04:08 maobaolong

I prefer not to change the default behavior. At this moment there are users who rely on this feature to manage the life cycle of their data.

HelloHorizon avatar Aug 02 '22 20:08 HelloHorizon

I prefer not to change the default behavior. At this moment there are users who rely on this feature to manage the life cycle of their data.

If not considering backward compatibility, I would say FREE is a better default. @HelloHorizon Do we know roughly which users are relying on the default DELETE action?

jiacheliu3 avatar Aug 09 '22 14:08 jiacheliu3

I prefer not to change the default behavior. At this moment there are users who rely on this feature to manage the life cycle of their data.

If not considering backward compatibility, I would say FREE is a better default. @HelloHorizon Do we know roughly which users are relying on the default DELETE action?

People in the US use this function to meet GDPR requirements.

HelloHorizon avatar Aug 09 '22 16:08 HelloHorizon

@maobaolong @DamonFool Since we have backward compatibility promises to fulfill, we will not change the default TTL action from DELETE to FREE. So you will need to manually configure the action to be FREE whenever you configure the TTL. Please let me know if you have any concerns, thanks!

jiacheliu3 avatar Aug 10 '22 01:08 jiacheliu3

Closing this PR due to the discussion above. We will keep the default action for TTL. Thank you all for the contribution and I look forward to your other PRs :)

jiacheliu3 avatar Jan 12 '23 14:01 jiacheliu3

FYI we have recently changed the default to FREE https://github.com/Alluxio/alluxio/pull/16823 Hope this helps :)

jiacheliu3 avatar Feb 17 '23 02:02 jiacheliu3