v6d
v6d copied to clipboard
v6d-io
vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)
What do these changes do? ------------------------- - Implement arrow fragment by grin apis - Implement grin apis using arrow fragment Related issue number -------------------- Fixes #issue number
Remove the local registry introduced in #1137 as well.
- vineyard-core - vineyard-foreign-loader - vineyard-basic - vineyard-presto - vineyard-spark
Describe your problem --------------------- Current spill/reload/migration is implemented into the vineyardd server and is not easily be plugged. Refactor proposal: - implements a standalone binary `vineyard-sealer`, `vineyard-migrator` - deployment: -...
Describe your problem --------------------- Why? Any workaround?  ### The behaviour that you expect to work: Additional context ------------------ Add any other context about the problem here.
Describe your problem --------------------- as titled. Additional context ------------------ Add any other context about the problem here.
Describe your problem --------------------- Integrate with the https://github.com/unsafecoerce/objectfs to current vineyard-io to replace the ad-hoc I/O adaptors based on arrow's filesystem APIs to ease the distribution and environment setup. Additional...
Describe your problem --------------------- There's a todo: https://github.com/v6d-io/v6d/blob/main/modules/graph/fragment/arrow_fragment.vineyard-mod#L690 and the logic to compute total edges for directed graphs is incorrect: https://github.com/v6d-io/v6d/blob/main/modules/graph/fragment/arrow_fragment.vineyard-mod#L288 Additional context ------------------ Add any other context about the...
Describe your problem --------------------- TBF.
Describe your problem --------------------- It would be great if pointers keep valid between processes, that means a data structure on vineyard can be directly used by another process, without the...