Rui Mo
Rui Mo
Hi Hongze, which query are you testing?
Hi Hongze, I tired debug build, but only found below error for q1. For the metrics issue, not sure this [PR](https://github.com/oap-project/gluten/pull/298) can solve the error you met. ``` 22/07/29 10:58:31,987...
Hi Zhenhui, looks like a custom format "dwrf" to Substrait is not supported. If running with "spark.read.format("dwrf").load", below error occurs. ``` Reason: ReaderFactory is not registered for format unknown Retriable:...
> > Hi Zhenhui, looks like a custom format "dwrf" to Substrait is not supported. If running with "spark.read.format("dwrf").load", below error occurs. > > ``` > > Reason: ReaderFactory is...
Verified locally on TPC-DS.
Velox has added hdfs read support with below commit: https://github.com/facebookincubator/velox/commit/1fc1fec67cd3e1373da1cf03a18a21496382d8c3. @zhouyuan has a [PR](https://github.com/oap-project/gluten/pull/152) working in progress to integrate it with gluten. Maybe yuan can help clarify a bit.
@mimitoling There are two pending PRs on hdfs support, [PR#388](https://github.com/oap-project/gluten/issues/388) and [PR#152](https://github.com/oap-project/gluten/pull/152). Some verification and testing work are still WIP.
Looks like this PR is not needed any more. Closing it for now. Feel free to reopen it if it's still needed.
The format issue should also be fixed.