David Li
David Li
> In the ArrayImporter code, the CDataReferenceManager releases the memory as soon as the import is complete: > > ``` > // This keeps the array alive as long as...
My objection here is that the semantics of what is going on here are unclear. We can add code that makes things pass tests but if the _intent_ is already...
eek, and right now we don't even know the buffer size so we can't actually do any proper accounting. hmm. https://github.com/apache/arrow/blob/83ad54c6c56e477efd570dba5ec12f87da6a68d1/java/c/src/main/java/org/apache/arrow/c/ArrayImporter.java#L144-L146
The pools only track memory allocated by Arrow for the purpose of data buffers, so it would make sense that they mostly show 0. (For Flight, we try to reuse...
It's going to depend on the allocator, but going with the assumption that this is gRPC-allocated memory, it should help (I would assume glibc tries to make use of previous...
Thanks for chiming in Wes - I'll look into the process and follow up on the mailing list @rafael-telles.
BTW, please let us know when you think this is ready for a full review
This can be rebased against the accepted proposals now.
For the IP clearance (moved to #12830)
We should probably close this PR in favor of a new PR based on the cleared code