jay

Results 90 comments of jay

> > Question 1: The limit was not pushed down to the scan operator, but the limit expression was still shown in the physical plan. > > * This is...

> > Question 1: The limit was not pushed down to the scan operator, but the limit expression was still shown in the physical plan. > > * This is...

@srilman I want to confirm one thing, which is the meaning of the expression "local_limit". For example, when I do read_lance, each fragment in the scannode is a task. As...

https://github.com/Eventual-Inc/Daft/pull/4612/files @srilman @colin-ho Similar to the implementation in this file, if the datasource itself does not support pushdown, the pushdown will not display the filter. Instead, a global filter will...

@srilman ![Image](https://github.com/user-attachments/assets/72b67e75-19c2-4cfb-a18c-cc7e285647ec)Currently, lance does not support partial limit. I have implemented it here.https://github.com/Eventual-Inc/Daft/pull/4622/files

![Image](https://github.com/user-attachments/assets/eff9eca9-8e77-4a46-82b7-ecbfb731a9d8)

@srilman Could you please take a look at the discussion here again? Because there are some historical unit tests (UTs) in https://github.com/Eventual-Inc/Daft/pull/4612. If possible, I need to change the expectations...

@weixiuli Lance supports the `OSS` protocol. You can directly release the code here to `OSS` and try it out. Contributions are welcome. https://github.com/Eventual-Inc/Daft/blob/ec202771d0b031eee2b3538cfcd15ad6f4aead38/daft/io/object_store_options.py#L10