zerodb icon indicating copy to clipboard operation
zerodb copied to clipboard

Switch from Python pickles to other serialization format

Open michwill opened this issue 9 years ago • 5 comments

Since we could have native clients in languages other than Python, we'd like to switch to object serialization other than pickle. Something similar to jsonpickle + msgpack (but without arbitrary code execution). This is a longer term goal

michwill avatar Dec 10 '15 16:12 michwill

:+1:

dmisiuk avatar Dec 14 '15 00:12 dmisiuk

http://jmoiron.net/blog/python-serialization/

Ultimately for compatibility JSON encoding rather than pickling seems like the natural choice, the problem with pickle is that it's inherently tied Python.

HarryR avatar Jan 11 '16 11:01 HarryR

Certainly. I'm thinking of something more compact and fast, yet cross-language. What about msgpack?

michwill avatar Jan 11 '16 12:01 michwill

how about thrift?

IAlwaysBeCoding avatar Jan 26 '16 08:01 IAlwaysBeCoding

Fastest in Python seems to be msgpack. We will first switch to it in ZEO protocol, then in zerodb itself

michwill avatar Aug 04 '16 18:08 michwill