kamu-cli
kamu-cli copied to clipboard
kamu-data
New generation decentralized data lake and a streaming data pipeline
- `AddCommand::run()` (if `--replace` provided) - Take into account not only visibility (public/private), but also `DatasetPropertyName::AllowsAnonymousRead` - Remove `DatasetActionAuthorizer` from `PullService` and `PushService` - TBA
In order to process datasets in already existing workspaces, we need to perform ReBAC tables population (for `RebacRepository`'ies). For this, it is necessary to implement a one-time operation (`InitOnStartup` trait...
In `ConfigService::path_for_scope()` we expect a configuration file (in the case of the user level) in the home directory. As a user, I would like the `.kamuconfig` to be stored in...
The `kamu system gc` command supports clearing the cache and also claims support for clearing unreachable objects. The purpose of this ticket is to provide real support for unreachable object...
Currently the concurrency of tasks in `PullService.pull_multi()` is bounded only by engine allocations, but this means that a hundred ingests or syncs can be running at once. This has several...
Currently when using container-based ingest we direct container `stderr` into a file and then mention the path in an error. This is very inconvenient in the `kamu-node` setting as these...
### Describe the bug Currently changing an environment variable does not invalidate the ingest cache ### Steps To Reproduce 1. Use a dataset that templates in some env vars 2....
## Description Closes: #issue ## Checklist before requesting a review - [ ] Unit and integration tests added - [ ] Compatibility: - [ ] Network APIs: ✅ - [...
Private Datasets feature works thanks to Outbox system, or in particular through the use of `CreateDatasetUseCase`. In the case of transport protocols, not all parts of them use `CreateDatasetUseCase`. Needs...