hypertools icon indicating copy to clipboard operation
hypertools copied to clipboard

support streaming data

Open andrewheusser opened this issue 8 years ago • 4 comments

e.g.

hyp.plot(streaming_data, streaming=True)

or could be inferred from the structure of streaming_data

andrewheusser avatar Apr 18 '17 15:04 andrewheusser

Ideally data streams would be just another type of supported data types, in addition to pandas dataframes and numpy arrays.

So we'd use some initial samples to compute the dimensionality reduction transform, and then all future samples would be added to the plot dynamically using that transform.

jeremymanning avatar May 30 '17 17:05 jeremymanning

(so I'd vote for no streaming flag)

jeremymanning avatar May 30 '17 17:05 jeremymanning

Potentially useful library (thanks for the twitter tip, @andrewheusser!): http://streamz.readthedocs.io/en/latest/

A tutorial-style description may be found here: https://matthewrocklin.com/blog//work/2017/10/16/streaming-dataframes-1

jeremymanning avatar Oct 22 '17 00:10 jeremymanning

This might be useful for adding support for streaming data: https://ipywidgets.readthedocs.io/en/latest/

jeremymanning avatar Mar 06 '18 19:03 jeremymanning