Xuanwo
> Does this depend on a distributed compute engine? I think this can work on a distributed query engine but not required.
Makes sense. I will update the README first.
The C/C++ test failed, which is a bit weird. I'll try to figure out what happened. I'm guessing it's related to our `Arc` been dropped while C still hold it.
Should be fixed by https://github.com/apache/opendal/pull/5662
> @Xuanwo can we have this merged? 👀 I didn't see other concerns so far. Let's move.
I personally believe this won't be an issue anymore once our ecosystem is fully set up on Rust Edition 2024.
Some information that maybe useful for you: https://xuanwo.io/2024/03-how-to-condense-800-integration-tests-into-80-losslessly/
> Not yet, but we have been experimenting with [OpenDAL](https://github.com/apache/incubator-opendal), which was recently used to add a [WebHDFS sink](https://github.com/vectordotdev/vector/pull/16557), and does have support for GCS. It could be an avenue...
> Hey! That'd be great! I think starting with the implementation makes sense. We can help with the docs if you get stuck. That's really appreciated. I will find some...
I believe this can be addressed by configure proxy per-request: https://github.com/seanmonstar/reqwest/issues/2641