Ian O'Connell

Few challenges with that... 1) If it looses all mapside combination we suffer hot key issues in that single bolt, the serialization alone from that could overwhelm things. Ultimately however...

Does this test pass or fail? You could open this as a simple unit test in a PR too thats failing.

Interesting, the writtenPostSum in TestGraphs was done for the storm one, no idea how the StormLaws entry got dropped

Interesting, basically doing the un-necessary also is the issue right?

They are collapsed, it just occurs after deciding where they should live. All flatmap's, join's, and option maps are collapsed.

summingbird doesn't actually know anything about it really, the storm/hadoop launchers handle that. Summingbird is a pure library in that regard, when those things launch it it supplies configs/code to...

Basically the storm and hadoop launcher commands encode this information into the classpath, so thats how it gets passed around. when you do hadoop jar mySummingbirdJar.jar , the hadoop jar...

It sounds like your already running it, did you do a kill command of the topology between launches? On Fri, Jan 16, 2015 at 12:54 PM, kandu009 [email protected] wrote: >...

The storm jar command both copies and starts the topology. It operates similar to the Hadoop jar command On Friday, January 16, 2015, kandu009 [email protected] wrote: > @ianoc https://github.com/ianoc yes...