arrow-julia icon indicating copy to clipboard operation
arrow-julia copied to clipboard

Does this pkg provide the plasma In-Memory Object Store?

Open mkschulze opened this issue 5 years ago • 2 comments

Hello,

just wondering if it's in like in the pyarrow package.

https://arrow.apache.org/docs/python/plasma.html

Thx!

mkschulze avatar Oct 10 '20 06:10 mkschulze

Currently there's no interface for interacting with a plasma store. From a quick look at what plasma is, it sounds like it would be pretty easy to make a generic Julia client that could put/get objects. Probably more work is supporting arbitrary Julia object sterilization in Arrow.jl. I'm not familiar with how pyarrow does their object serialization, but perhaps we could do something similar. My hesitation is knowing that totally generic serialization in Julia can be a lot of work; but maybe there are simple cases we could support.

quinnj avatar Oct 10 '20 15:10 quinnj

Maybe this project can serve as some inspiration: https://github.com/russellromney/brain-plasma

It wraps the plasma store and adds a namespace functionality. Could eventually replace redis in the long run maybe.

mkschulze avatar Oct 10 '20 15:10 mkschulze

My understanding is that plasma is no longer maintained and isn't recommended any more

quinnj avatar Jun 09 '23 03:06 quinnj