lance
lance copied to clipboard
ManifestWriteConfig not settable from python commit API
Users can use the fragment API to create fragments and then commit a dataset using the python commit method (this is an advanced use case).
However, it is not possible to set the ManifestWriteConfig from python. This means:
- When creating an empty dataset it is always created in v1 format.
- There is no way to choose stable row ids when creating a dataset using the commit approach.
Should we expose this config to the python API? Should we make the storage version and/or stable row id flags part of the "operation"? Is there some other approach we can take?
CC @wjones127