algebird icon indicating copy to clipboard operation
algebird copied to clipboard

algebird-bufferable

Open avibryant opened this issue 11 years ago • 14 comments

This is just a start, and shouldn't be merged yet, but: defining some Bufferable implementations for Algebird objects so that we don't have to use Kryo for long-term serialized storage.

avibryant avatar May 24 '13 05:05 avibryant

Of course any bijection module could go in either bijection or the project on which the module depends, but I wonder if this should just go into https://github.com/twitter/bijection/tree/develop/bijection-algebird? Good stuff, though, this is really great.

sritchie avatar May 24 '13 05:05 sritchie

I think the argument for making this part of algebird rather than bijection is that its rate of change will be more closely tied to algebird's; we're more likely to add new data types to algebird that need new bufferable implementations, than we are to change how bijection/bufferable work.

avibryant avatar May 24 '13 15:05 avibryant

Ah, sure, good point. Should we start this and think about folding bijection-algebird back in to here?

sritchie avatar May 24 '13 16:05 sritchie

Hmm, looks like 2.10 isn't happy.

sritchie avatar May 31 '13 19:05 sritchie

Fix the 2.10 issues and the comments and we merge (and publish in the next week or two).

johnynek avatar Jun 19 '13 04:06 johnynek

Do you think we're better to just move to scala-pickling, or are you confident that Bufferable is going to be used/useful in the long term?

avibryant avatar Jun 19 '13 04:06 avibryant

I assume in the long run pickling will be a win, but currently it looks like we need 2.10 and I'm not sure the Java story, which matters for us.

johnynek avatar Jun 19 '13 19:06 johnynek

Can I talk you into getting this green?

I want to merge it for the next release in a week or two.

(really want one for BloomFilter too, by the way).

johnynek avatar Jun 25 '13 22:06 johnynek

I'll try to find time in the next week yeah.

avibryant avatar Jun 25 '13 22:06 avibryant

Boom, we're about to merge algebird-bijection... let's move these over there. I like this.

sritchie avatar Jul 17 '13 15:07 sritchie

Hey @avibryant, can we get you to move these into algebird-bijection?

sritchie avatar Jul 21 '13 16:07 sritchie

Hey, really sorry I haven't gotten to this yet; not sure when I'll have time. If someone else wants to take it on, great, otherwise I'll get to it when I can, but either way we shouldn't hold up a release for it obviously.

avibryant avatar Jul 22 '13 04:07 avibryant

Sorry my bad, git foo on cmd line broke stuff and closed all of these

ianoc avatar Aug 04 '15 00:08 ianoc

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

CLAassistant avatar Jul 18 '19 15:07 CLAassistant