lance icon indicating copy to clipboard operation
lance copied to clipboard

ManifestWriteConfig not settable from python commit API

Open westonpace opened this issue 1 year ago • 1 comments

Users can use the fragment API to create fragments and then commit a dataset using the python commit method (this is an advanced use case).

However, it is not possible to set the ManifestWriteConfig from python. This means:

  • When creating an empty dataset it is always created in v1 format.
  • There is no way to choose stable row ids when creating a dataset using the commit approach.

Should we expose this config to the python API? Should we make the storage version and/or stable row id flags part of the "operation"? Is there some other approach we can take?

westonpace avatar Aug 16 '24 15:08 westonpace

CC @wjones127

westonpace avatar Aug 16 '24 15:08 westonpace