Rob Meng

* [ ] e2e tests for fp16 and bf16 vector index creation with accelerator * [ ] e2e tests for migrating indices when casting vector columns * [ ] e2e...

two issues fixed: * when using fp16 and cosine together, the distance we get is usually greater than `1e-6` even when we hit an exact match. * fixed by comparing...

Make an internal API warning macro

1

We often expose internal APIs. These APIs are `pub` but really shouldn't be used as we will not garueentee the stability. Maybe we could use `depercated` mechanism to generate a...

``` FAILED python/tests/test_optimize.py::test_compact_with_write - OSError: Dataset at path tmp/pytest-of-runner/pytest-0/test_compact_with_write0/dataset was not found: LanceError(IO): Generic LocalFileSystem error: Unable to access metadata for tmp/pytest-of-runner/pytest-0/test_compact_with_write0/dataset/_versions/10.manifest-e86142ed-10fd-41e6-9dea-1d06832ae144: IO error for operation on /tmp/pytest-of-runner/pytest-0/test_compact_with_write0/dataset/_versions/10.manifest-e86142ed-10fd-41e6-9dea-1d06832ae144: No such...

we completed `VectorIndexExtension` type in https://github.com/lancedb/lance/pull/2250 Existing V2 vector indices should all be refactored into implementations of `VectorIndexExtension`, to make sure we always expose a consistent set of APIs on...

Enable stricter clippy lints

2

candidates: * `clippy::pedantic` which has a bunch of type cast safety checks * [clippy::unwrap_used](https://rust-lang.github.io/rust-clippy/master/index.html#unwrap_used) * maybe more we could pick from the `restriction` category: https://rust-lang.github.io/rust-clippy/master/index.html#?levels=allow,none&groups=restriction

flaky test: potentially flaky distance::dot::tests::test_dot_f32

1

https://github.com/lancedb/lance/actions/runs/8794212752/job/24133303595

## Feature Request Love the project! Just one request on response streaming. Most (because I haven't used all of them) gRPC implementation passes a `sink/writer` handle into the handler stub....

chore: bump arrow to 51

1

NOTE: while the released `0.10.15` depends on `arrow = 50`, we have bumped to `arrow = 51` on top of `main`.

`manylinux_2_24` is EOL and has worse compatibility with OSs