Yue

Results 35 comments of Yue

> By the way, this PR addresses `RecordBatchFileReader` but not `RecordBatchReader`. Do you plan to do that as well? I tried adding the pyarrow API for `RecordBatchReader` locally previously, but...

@pitrou I made some additional changes to the PR, could you please help to review? Thanks.

> @niyue Are you planning to work on this? > > Otherwise @milesgranger you might be interested in taking this up? Hi @pitrou, sorry I got too busy since last...

@pitrou I pushed a new commit a minute ago. I followed your suggestion to add corresponding API for `RecordBatchReader` API in pyarrow, and a basic unit test to cover this...

@pitrou I am not sure if you see my previous comment. I made some change previously, and this PR is ready for review, could you please help? Thanks.

No problem. I will check them out and see if I can get them addressed. Thanks for the review.

@pitrou sorry for the late response. There are two failed CI builds, and they don't seem relevant in this issue. I rebased onto the latest master branch anyway.

I think introducing a more nested structure will make the graph more difficult to understand. The examples I follow are (and they don't use subgroup when modelling): * https://hacks.mozilla.org/2018/10/webassemblys-post-mvp-future/ *...

I found this issue is probably caused by some non deterministic problem. I tried to narrow down the issue by removing some test source code from my code base and...

After several attempts (< 10 attempts), the issue occurred again. But so far I have no idea how this gets triggered.