Christopher C. Aycock

Results 19 comments of Christopher C. Aycock

Probably should tackle #43 before adding generic `repr()` since the `save()` logic will have to go into Sema.

Thinking through some items, perhaps `load()` should be batch by default; users must ask for `stream_load()`. VVM ops can optionally have a *streaming* version takes a state. If a linear...

To build this, we will keep the streaming data as a stub; the `stream_load()` function will be a batch operation, but its `mode` will allow us to practice lineage and...

The "streaming register" passed to a streaming function (whether UDF or VVM op) must exist outside the scope of the function definition and must be initialized before the loop. Trying...

Streaming registers present an issue for grouped aggregations: the split DFs need their own state. Additionally, the categories and indices of groupings need to be saved from one chunk to...

Optimization: Since stateless VVM ops don't need a streaming register, a UDF that only calls stateless ops is also stateless. And this is recursive; just need to track that a...

The proposal is to issue a pre-release of chunked streaming without optimizations or table syntax. Then 0.7.0 will add grouped aggregations and joins where the right table is batch. After...

The *first pass at state registers* still needs work on UDF. Proposal is to have Sema duplicate the function definition when the call is in `Stream` mode, similar to how...

CC @richardfeynmanrocks