warp10-platform feat(directory): add a series clean while reading HBase

closes #1107

Jul 13 '22 12:07 aurrelhebert

All committers have signed the CLA.

Jul 13 '22 12:07 CLAassistant

Hello, The 2.11.0 is now released with TrustedDirectoryPlugin.

As your feature is very specific, it won't be merged into the core, but it could now be a plugin. Please contact us if TrustedDirectoryPlugin do not fit your needs, or if you want us to help or add features in the core to build your plugin.

Aug 26 '22 08:08 pi-r-p

Given HBase is due for removal in 3.x and this won't be fixed in 2.x, it is probably better you close this PR.

Mar 03 '23 15:03 hbs

How will you handle series lifecycle in 3.x?

Mar 10 '23 10:03 aurrelhebert

What do you mean by "series lifecycle"?

Mar 10 '23 12:03 hbs

Last activity remains, and we have to make sure that people with lots of "temporary" gts use it...

Mar 10 '23 15:03 pi-r-p

Exactly, the aim of this PR was to be able to handle "temporary" GTS. For example, some series that may be active a couple of days/months/years. Moreover the idea behind this PR was to be able to clean the directories of this series when they were inactive for a given elapse time (for a Warp10 application, or for all series).

Mar 21 '23 15:03 aurrelhebert

We close this PR and we will discuss together how we can bring a lifecycle management for series, emulate a TTL behavior for warp10 3.x, etc... a good topic for a summer BBQ ;)

Mar 28 '23 14:03 StevenLeRoux

As you prefer, we do use this PR on production and it's working well since July.

Mar 29 '23 07:03 aurrelhebert