kamu-cli
kamu-cli copied to clipboard
kamu-data
New generation decentralized data lake and a streaming data pipeline
### Describe the bug The [`ca.vancouver.opendata.property.block-outlines`](https://github.com/kamu-data/kamu-contrib/blob/master/ca.vancouver.opendata/property/block-outlines/ca.vancouver.opendata.property.block-outlines.yaml) contrib dataset is using Apache Sedona to re-project data. The schema that this results in currently cannot be processed by kamu's output CSV /...
### Describe the bug The catalog with the transaction goes into a background task (SmTP websocket), which when working with `RunInDatabaseTransactionMiddleware` causes a transaction leak ### Steps To Reproduce Use...
I hit an issue while trying to pull a nested data source structured as follows: ```json { "starred_at": "2020-07-05T01:34:55Z", "user": { "login": "onyalcin", "id": 7300802 } } ``` Received the...
At the moment, we have E2E tests, but they are running sequentially. The reason is the use of a hardcoded port when starting the HTTP server. The purpose of this...
- [x] Hard compactions for root datasets - [x] CLI command #320 - [x] Flow system #583 - [x] Button in dataset settings UI https://github.com/kamu-data/kamu-web-ui/issues/302 - [x] Display task outcome...
### Motivation - Reduce test compilation time - Reduce the disk space utilization at CI
- Epic: https://github.com/kamu-data/kamu-web-ui/issues/172 - RFC: [link](https://docs.google.com/document/d/1bycQpRD015YyKNZD1atRScC2uChVWStAE70UsdZjX0g) ### Steps - **Milestone 1: Base** - [x] https://github.com/kamu-data/kamu-cli/issues/677 - [x] https://github.com/kamu-data/kamu-cli/issues/720 - [x] https://github.com/kamu-data/kamu-cli/issues/754 - [x] https://github.com/kamu-data/kamu-cli/issues/871 - [x] https://github.com/kamu-data/kamu-cli/issues/727 - [x] https://github.com/kamu-data/kamu-cli/issues/724...
Create graphql API for support environment variables. Initial developments according to the API schema(prototype) Schema for a list of environment variables (Type **Dataset** already exists): ``` type Dataset { """...
We shot ourselves in the foot several times with DI - we need to simplify its use and automate some checks to avoid it in future. This is a WIP...