hudi icon indicating copy to clipboard operation
hudi copied to clipboard

[HUDI-4895] Object store based lock provider

Open YuweiXiao opened this issue 3 years ago • 1 comments

Change Logs

Currently, we have FileSystemBasedLockProvier, which relies on the atomic guarantee of the underlying file system. Specifically, only with filesystem's atomic rename & atomic create capability, the LockProvider can work properly.

This PR enables Object store (e.g, AliyunOSS) as a lock provider.

Impact

No API change.

Risk level: none | low | medium | high

LOW.

Contributor's checklist

  • [x] Read through contributor's guide
  • [x] Change Logs and Impact were stated clearly
  • [ ] Adequate tests were added if applicable
  • [ ] CI passed

YuweiXiao avatar Sep 22 '22 02:09 YuweiXiao

CI report:

  • c0c9616166bf46216cdaf9ff8d634770e325e472 Azure: FAILURE
Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

hudi-bot avatar Sep 22 '22 05:09 hudi-bot