amoro icon indicating copy to clipboard operation
amoro copied to clipboard

[Bug]: Fail to get table list in Hive catalog

Open xxubai opened this issue 6 months ago • 1 comments

What happened?

Can not get iceberg table list in Hive catalog

Affects Versions

master/0.8.0

What table formats are you seeing the problem on?

Iceberg

What engines are you seeing the problem on?

No response

How to reproduce

No response

Relevant log output

2025-06-10 05:32:52,891 ERROR [JettyServerThreadPool-89] [org.apache.hadoop.hive.metastore.ObjectStore] [] - Error loading PartitionExpressionProxy
org.apache.hadoop.hive.metastore.api.MetaException: org.apache.hadoop.hive.ql.optimizer.ppr.PartitionExpressionForMetastore class not found
	at org.apache.hadoop.hive.metastore.utils.JavaUtils.getClass(JavaUtils.java:54) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.ObjectStore.createExpressionProxy(ObjectStore.java:538) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.ObjectStore.initializeHelper(ObjectStore.java:495) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:421) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:376) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77) ~[hadoop-common-3.4.0.jar:?]
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:159) ~[hadoop-common-3.4.0.jar:?]
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:126) ~[hadoop-common-3.4.0.jar:?]
	at org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:59) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:67) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStoreForConf(HiveMetaStore.java:720) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMSForConf(HiveMetaStore.java:698) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:692) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:769) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:540) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:80) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:93) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:8678) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:169) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:137) ~[hive-standalone-metastore-3.1.3.jar:3.1.3]
	at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]
	at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:?]
	at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:?]
	at java.lang.reflect.Constructor.newInstance(Constructor.java:490) ~[?:?]
	at org.apache.amoro.utils.DynConstructors$Ctor.newInstanceChecked(DynConstructors.java:56) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.utils.DynConstructors$Ctor.newInstance(DynConstructors.java:70) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.hive.AuthenticatedHiveClientPool.createHiveMetaStoreClient(AuthenticatedHiveClientPool.java:54) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.hive.AuthenticatedHiveClientPool.lambda$newClient$0(AuthenticatedHiveClientPool.java:91) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:268) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:243) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at java.security.AccessController.doPrivileged(Native Method) ~[?:?]
	at javax.security.auth.Subject.doAs(Subject.java:361) ~[?:?]
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
	at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:243) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.hive.AuthenticatedHiveClientPool.newClient(AuthenticatedHiveClientPool.java:91) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.hive.AuthenticatedHiveClientPool.newClient(AuthenticatedHiveClientPool.java:38) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.client.ClientPoolImpl.get(ClientPoolImpl.java:132) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.client.ClientPoolImpl.run(ClientPoolImpl.java:63) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.client.ClientPoolImpl.run(ClientPoolImpl.java:58) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.hive.CachedHiveClientPool.lambda$run$2(CachedHiveClientPool.java:82) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:268) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:243) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at java.security.AccessController.doPrivileged(Native Method) ~[?:?]
	at javax.security.auth.Subject.doAs(Subject.java:361) ~[?:?]
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
	at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:243) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.hive.CachedHiveClientPool.run(CachedHiveClientPool.java:82) ~[amoro-common-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.hive.utils.HiveTableUtil.getAllHiveTables(HiveTableUtil.java:172) ~[amoro-mixed-hive-0.8.0-incubating.jar:0.8.0-incubating]
	at org.apache.amoro.server.dashboard.controller.TableController.getTableList(TableController.java:569) ~[amoro-ams-0.8.0-incubating.jar:0.8.0-incubating]

Anything else

No response

Are you willing to submit a PR?

  • [x] Yes I am willing to submit a PR!

Code of Conduct

  • [x] I agree to follow this project's Code of Conduct

xxubai avatar Jun 10 '25 05:06 xxubai

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

github-actions[bot] avatar Dec 08 '25 00:12 github-actions[bot]