Christopher J. 'CJ' Wright

Results 173 comments of Christopher J. 'CJ' Wright

One interesting side effect of this would be that we could potentially use this to manage our exceptions as well. We could: 1. Create a blacklist of types which operators...

I think this has been handled some by #306 adding timestamp metadata could be done by the source. Another potential iteration would be to have `metadata` functions that return `dicts`...

@opensourcechris Would you be able to put some of that code up? I'm particularly interested to see the subclass of DiGraph (since I was working on that too) and the...

Hmm ok I like that vision of the problem. As a side note we may want to look to `itertools` to find new nodes to implement. Keeping track of the...

That's fair.

Does `emit` report the dask futures? Can those be awaited?

In the simpler case can the thread be `joined`? Does that thread respect backpressure?

There is some description why `sink`s are cached here: https://streamz.readthedocs.io/en/latest/core.html#modifying-and-cleaning-up-streams The gist of it is that they anchor the pipeline and need to be explicitly removed as opposed to most...

Btw this is the PR which introduced this behavior: https://github.com/python-streamz/streamz/pull/72