storey
storey copied to clipboard
real-time data + ML pipeline
This pr focus in implementation of source, driver for SqlDB. SqlDriver is not fully supported in the aggregation query flow. https://jira.iguazeng.com/browse/ML-2610
Signed-off-by: Eyal Salomon
There seem to be well maintained docs here - the README for storey doesn't explain many of the classes. https://docs.mlrun.org/en/latest/api/storey.transformations.html
I catch exception during writing data to on-line feature store via MLRun see exception (I made performance tests) Information from log: `> 2021-12-08 12:13:57,616 [error] Pushing error to error stream:...
[ML-6015](https://iguazio.atlassian.net/browse/ML-6015) Based on the preexisting internal `_ConcurrentJobExecution` class. With support for three concurrency mechanisms: asyncio, threading, and multiprocessing. [ML-6015]: https://iguazio.atlassian.net/browse/ML-6015?atlOrigin=eyJpIjoiNWRkNTljNzYxNjVmNDY3MDlhMDU5Y2ZhYzA5YTRkZjUiLCJwIjoiZ2l0aHViLWNvbS1KU1cifQ
- Add Makefile target (make coverage). - Add integration with GitHub. [ML-6377](https://iguazio.atlassian.net/browse/ML-6377) [ML-6377]: https://iguazio.atlassian.net/browse/ML-6377?atlOrigin=eyJpIjoiNWRkNTljNzYxNjVmNDY3MDlhMDU5Y2ZhYzA5YTRkZjUiLCJwIjoiZ2l0aHViLWNvbS1KU1cifQ
[ML-6715](https://iguazio.atlassian.net/browse/ML-6715) [ML-6715]: https://iguazio.atlassian.net/browse/ML-6715?atlOrigin=eyJpIjoiNWRkNTljNzYxNjVmNDY3MDlhMDU5Y2ZhYzA5YTRkZjUiLCJwIjoiZ2l0aHViLWNvbS1KU1cifQ