kartothek icon indicating copy to clipboard operation
kartothek copied to clipboard

Support writing paths for `DatasetFactory`

Open lr4d opened this issue 5 years ago • 0 comments

The DatasetFactory still has certain design flaws and it was not intended to be used for writing paths. Primarily because it only makes sense if the dataset actually exists since it's effectively a caching layer. That's obviously not the case if we're in a pure write operation. I'm afraid that when using it for storage operations as well this leads to some weird bugs.

Originally posted by @fjetter in https://github.com/JDASoftwareGroup/kartothek/pull/316

lr4d avatar Jul 22 '20 12:07 lr4d