Xiaoying Wang

> Hi @wangxiaoying, > > I assume you saw the last merged commit adding the explain functionality. Let us know if you have any further questions. More than happy to...

We haven't support array types in `arrow` yet. The implementations of `arrow2` [here](https://github.com/sfu-db/connector-x/blob/main/connectorx/src/destinations/arrow2/arrow_assoc.rs) can be used as a reference to enable this in `arrow`.

> @wangxiaoying got it. Can I send a PR for `arrow` in that case? Of course. You are very welcome to submit a PR! Please let me know if you...

Hi @helio-sb , To narrow down the problem. 1. Is your data updating (the number of rows in the table is changing) when fetching the data? 2. Does the seg...

> hey [@wangxiaoying](https://github.com/wangxiaoying) , thanks for the reply.. 1 . no , no changes in the data 2. running after a while, around 1-2 minutes. 3. no specific partition setting,...

Hi @helio-sb @komodovaran , we recently fixed a memory leak issue in version 0.4.1. Can you try this latest version and test?

Hi @surister , thanks for bringing up this! The `partition_range` parameter is designed to let users with domain knowledge manually set the range in order to avoid the additional `MIN`...

> thanks for the thorough explanation, couldn't we make the memory allocation more efficient if we issued a `select count(*) from tbl where partition_on > partition_range.0 and partition_on < partition_range.1`...

I still think we need to keep the semantic of `read_sql (con, sql)` function, which simply fetches the result of the `sql` query using the connection `con`. All partition related...

Just in case it might be helpful, here is a log snippet related to the serialization overhead of spark execution with wayang I mentioned above: ``` 24/03/26 18:18:26 WARN TaskSetManager:...