kartothek
kartothek copied to clipboard
Support writing paths for `DatasetFactory`
The DatasetFactory still has certain design flaws and it was not intended to be used for writing paths. Primarily because it only makes sense if the dataset actually exists since it's effectively a caching layer. That's obviously not the case if we're in a pure write operation. I'm afraid that when using it for storage operations as well this leads to some weird bugs.
Originally posted by @fjetter in https://github.com/JDASoftwareGroup/kartothek/pull/316