hipipe
hipipe copied to clipboard
iterait
Super fast C++17 data transformation pipeline (with Python interface).
Currently `stream::rebatch` uses `column_t::take` that has a complexity linear to the number of elements and thus `rebatch` may have up to quadratic complexity when large batch is rebatched to batch...
This can be based on boost::log v2: [link1](http://gernotklingler.com/blog/simple-customized-logger-based-boost-log-v2/), [link2](http://www.boost.org/doc/libs/1_64_0/libs/log/doc/html/log/detailed/sources.html), [link3](http://gernotklingler.com/blog/simple-customized-logger-based-boost-log-v2/) Or [spdlog](https://github.com/gabime/spdlog).
> Such an overload would filter all the columns in the stream.
> This may be useful for generators that are non-trivial and don't need to be used for each item. > > The implementation is quite simple: just propagate the `cond`...