Rob Meng

> Related: https://github.com/lancedb/lance/issues/1980 > > > > If we want to do the threading in Rust for Python users, that seems reasonable. I'm less certain we need to do this...

> We want to avoid datasets that are split between two different versions (e.g. some files in v1 and some in v2). I think this approach can cause that situation...

cc: @wjones127 @westonpace @eddyxu

@mapleFU Yeah roughly. This is making DynamoDB the source of truth and S3 a replica, but with some constraints on how out-of-sync the two stores can be. On the read...

hi @sandias42, with dynamo manifest store, the expected amount of IOs are as follows Read: * get latest dataset -- 1 full read (we always use consistent read) * get...

> This is indeed very interesting and useful in my opinion. I could see usage documentation on the lanceDb guides on storage options. However I don't understand if this feature...

Thank you so much!

> You should be able to install the newer dill later by ignoring this conflict. If this causes any issue, you can also try cloudpickle . Hi, with newer tools...