storehaus icon indicating copy to clipboard operation
storehaus copied to clipboard

Published 20 hours ago • verified publisher icon twitter

StorehausSourceTap

Open rubanm opened this issue 11 years ago • 4 comments

Addresses https://github.com/twitter/storehaus/issues/208

This is an untested first draft that adds some basic cascading wiring. Sending it out early for any design feedback as well as any missing big picture items.

I am thinking of having the source tap completely done before moving to the sink tap.

  • [ ] add source tap
  • [ ] add an example MapStore based source
  • [ ] add test
  • [ ] integration test with scalding + summingbird

rubanm avatar Feb 07 '14 06:02 rubanm

@rubanm as i would be a thankful user of a Summingbird-batching Storehaus tap (i will need a SinkTap pretty soon), do you already have plans for a final pull request? If i can be of any help with the SinkTap i would be happy to join you working on it.

AndreasPetter avatar Mar 21 '14 08:03 AndreasPetter

@AndreasPetter Sorry haven't been able to work on this for a while. You are more than welcome to start on the SinkTap and pull in any code from this PR if that's useful. I can help, and we have @johnynek of course :)

Thanks.

rubanm avatar Mar 21 '14 22:03 rubanm

:+1: love it

pkallos avatar May 30 '14 00:05 pkallos

CLA assistant check
All committers have signed the CLA.

CLAassistant avatar Nov 16 '19 23:11 CLAassistant