arctic icon indicating copy to clipboard operation
arctic copied to clipboard

VersionStore datatype specific metadata

Open bmoscon opened this issue 5 years ago • 4 comments

It would be useful if some datatype specific metadata were added to the metadata in version store. example - if storing a dataframe, could the metadata not contain more information about the index? My specific want would be to have min and max dates from the datetime index in the metadata. It seems useful and easily doable (on the first write store the min and max, update them as applicable in subsequent appends, etc). Any thoughts @dimosped @jamesblackburn ? Is there a feature that more easily exposes this information I'm not aware of, or are there compelling reasons to not do this in this way?

bmoscon avatar Aug 25 '18 15:08 bmoscon

I also think auto adding min and max for time column would save my current self manage metadata efforts.

xgdgsc avatar Sep 14 '19 14:09 xgdgsc

Has there been any work on this? I would be quite interested as well.

luongjames8 avatar Dec 10 '20 15:12 luongjames8

nope, PRs are welcomed

bmoscon avatar Dec 10 '20 18:12 bmoscon

Ok I have never done that before. Let me see what's involved...

luongjames8 avatar Dec 11 '20 04:12 luongjames8