Yizhong Zhang

Gentle ping @pang-wu , sorry for the late reply to this issue. I tested with the code you provided above and have 2 nodes for this test: > Node A...

I tried with Spark 3.3.2 and Spark 3.2.1, both of them passed the test. Got errors(same as [issue](https://stackoverflow.com/questions/44411493/java-lang-noclassdeffounderror-org-apache-hadoop-fs-storagestatistics)) on all Spark 3.1.x since Hadoop jars are not match.

It's weird `test_advanced_9` of [(Medium A-J)](https://buildkite.com/ray-project/oss-ci-build-pr/builds/24776#01889515-7d05-4850-8a52-1e4bfa2c7e34) failed in CI but worked well on my local device..

Gentle ping @ericl @rkooo567 for help, thanks~

> Could we also tag other reviews who have context on the original PR for review? @Deegue > > And let me know if there's anything I can help or...

> can you let me know what were the major changes from the PR that was merged? Thanks for comment, the major change is using arrow serialization for object store...