xloya

Results 34 comments of xloya

> @xloya, can you separate backports into individual PRs, please? Sure, but the unit tests of the patch of #3983 (Zorder strategy) would not pass until the patch of #3728...

@rdblue Already seperate them to #5847 and #5848, please review again when you have time, thx!

> @jerryshao @xunliu @shaofengshi Hi, I'm coming to talk about how to implement Python gvfs. After talking with @xloya offline, I think we have two ways. > > 1. Implement...

> I feel like solution 2 is a python wrapper for Hadoop client, while solution 1 is a pure java solution, right? I feel like solution 1 could be more...

@noidname01 Hi, we had a brief discussion on this issue with @jerryshao yesterday, and we agreed with solution 1. We can directly connect to storage SDKs such as S3 /...

@jerryshao @noidname01 @coolderli Hi, I have opened a draft PR(#3528, the code is not complete yet) for this. I will implement GVFS based on fsspec interfaces, some popular cloud storages...

> > @jerryshao @noidname01 @coolderli Hi, I have opened a draft PR(#3528, the code is not complete yet) for this. I will implement GVFS based on fsspec interfaces, some popular...

> Like [Ray support PyArrow filesystem](https://docs.ray.io/en/latest/data/quickstart.html#data-quickstart), I'm not sure it supports fsspec as well🤔 I think it is theoretically possible, because judging from the descriptions in the fsspec and PyArrow...