presto icon indicating copy to clipboard operation
presto copied to clipboard

hdfs is not supported as the external filesystem.

Open Stevenscj opened this issue 3 years ago • 1 comments

Presto version : 0.273.3 Presto JDBC version : 0.273.3 Presto coordinator : 1 , worker : 2 Data Source : Hive

After the local cache configuration is added to the hive.properties file:

` connector.name=hive-hadoop2 hive.metastore.uri=thrift://xx.xxx.xx.xx:9083 hive.config. resources=/data/hadoop/hadoop-3.3.3/etc/hadoop/core-site.xml, /data/hadoop/hadoop-3.3.3/etc/hadoop/hdfs-site.xml

cache.enabled=true cache.type=ALLUXIO cache.base-directory=fiLe:///data/cache/alLuxio cache.alluxio.max-cache-size=6GB `

When I open a table and get the data with DBeaver, an error occured below :

SQL Error [16777221]: Query failed (#20220708_012108_00000_hcm7u): hdfs is not supported as the external filesystem.

Stevenscj avatar Jul 08 '22 01:07 Stevenscj

you can refer to issue 17445

Li-GL avatar Jul 29 '22 00:07 Li-GL

There is an ongoing PR #18040 which once merged should fix this issue.

imjalpreet avatar Sep 12 '22 10:09 imjalpreet

Guess we can close this ticket then? @imjalpreet

pratyakshsharma avatar Dec 23 '22 08:12 pratyakshsharma

Maybe we could upgrade the version of alluxio client https://github.com/prestodb/presto/pull/19594

humengyu2012 avatar May 29 '23 12:05 humengyu2012

Maybe we could upgrade the version of alluxio client #19594

exactly. upgrade the version of alluxio client to 2.9.3 will fix the issue.

but why it was not shipped with latest release of presto deployment package since it had been merged several months already.

In presto 0.284(Nov 6, 2023) it's 2.8.1 which still have this issue.

twoyang0917 avatar Dec 04 '23 03:12 twoyang0917

Looks like upgrade was reverted as part of https://github.com/prestodb/presto/pull/20401

agrawalreetika avatar Dec 04 '23 06:12 agrawalreetika

@twoyang0917 I see Alluxio has been upgraded to 307 recently on master as part of https://github.com/prestodb/presto/pull/20437/files, you can verify if this fixes the issue you had.

agrawalreetika avatar Dec 07 '23 05:12 agrawalreetika

@twoyang0917 I see Alluxio has been upgraded to 307 recently on master as part of https://github.com/prestodb/presto/pull/20437/files, you can verify if this fixes the issue you had.

307 fixed the issue.

twoyang0917 avatar Dec 07 '23 05:12 twoyang0917

Awesome, thanks for confirming @twoyang0917. Will close this issue then.

agrawalreetika avatar Dec 07 '23 05:12 agrawalreetika