lumen icon indicating copy to clipboard operation
lumen copied to clipboard

streamz??

Open martindurant opened this issue 4 years ago • 2 comments

I'm sure we talked about this already, but it came up while chatting with @seibert .

In this library, you have data sources which poll a REST endpoint on some regular period, accumulate data, turn into dataframes, do some processing, and finally update a plot in the frontend (some part of a dashboard). Streamz does all of these things, including the ability to create multiple different views of the same dataset on one or more plots. Why not use streamz?

Would it make any difference if Intake already supported streamz? This is something I have long been meaning to do, but just needed the spur ( https://github.com/intake/intake-streamz very incomplete).

martindurant avatar Jan 05 '21 22:01 martindurant

Absolutely, in fact I'd like to generalize Lumen to support a variety of datatypes including xarray datasets. Still considering the best approach here to ensure all the filtering logic and so one works across all of them. Building out intake-streamz would certainly help too.

philippjfr avatar Jan 06 '21 12:01 philippjfr

Intake-streamz is on pypi and awaiting conda-forge at https://github.com/conda-forge/staged-recipes/pull/13692

martindurant avatar Jan 18 '21 15:01 martindurant