amoro icon indicating copy to clipboard operation
amoro copied to clipboard

[Bug]: When I finished config iceberg with s3,then i run sql in terminal get errors:

Open 245Bluesky opened this issue 8 months ago • 2 comments

What happened?

Image

Image

2025/03/31 16:52:31 new sql script submit, current thread pool state. [Active: 0, PoolSize: 1] 2025/03/31 16:52:31 terminal session dose not exists. create session first 2025/03/31 16:52:31 something error when execute script. 2025/03/31 16:52:31 java.lang.UnsupportedOperationException: getSubject is supported only if a security manager is allowed at java.base/javax.security.auth.Subject.getSubject(Subject.java:347) at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:588) at org.apache.spark.util.Utils$.$anonfun$getCurrentUserName$1(Utils.scala:2561) at scala.Option.getOrElse(Option.scala:189) at org.apache.spark.util.Utils$.getCurrentUserName(Utils.scala:2561) at org.apache.spark.SparkContext.(SparkContext.scala:316) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2714) at org.apache.spark.sql.SparkSession$Builder.$anonfun$getOrCreate$2(SparkSession.scala:953) at scala.Option.getOrElse(Option.scala:189) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:947) at org.apache.amoro.server.terminal.local.LocalSessionFactory.lazyInitContext(LocalSessionFactory.java:151) at org.apache.amoro.server.terminal.local.LocalSessionFactory.create(LocalSessionFactory.java:72) at org.apache.amoro.server.terminal.TerminalSessionContext.lazyLoadSession(TerminalSessionContext.java:178) at org.apache.amoro.server.terminal.TerminalSessionContext.access$200(TerminalSessionContext.java:44) at org.apache.amoro.server.terminal.TerminalSessionContext$ExecutionTask.lambda$get$0(TerminalSessionContext.java:211) at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:229) at org.apache.amoro.server.terminal.TerminalSessionContext$ExecutionTask.get(TerminalSessionContext.java:209) at org.apache.amoro.server.terminal.TerminalSessionContext$ExecutionTask.get(TerminalSessionContext.java:184) at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1812) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) at java.base/java.lang.Thread.run(Thread.java:1575)

Affects Versions

amoro-0.7.1

What table formats are you seeing the problem on?

No response

What engines are you seeing the problem on?

No response

How to reproduce

No response

Relevant log output


Anything else

No response

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

  • [x] I agree to follow this project's Code of Conduct

245Bluesky avatar Mar 31 '25 09:03 245Bluesky

Now, it happens : Image

2025/04/01 14:45:25 new sql script submit, current thread pool state. [Active: 0, PoolSize: 1] 2025/04/01 14:45:25 terminal session dose not exists. create session first 2025/04/01 14:45:25 something error when execute script. 2025/04/01 14:45:25 java.lang.RuntimeException: Run with ugi request failed. at com.netease.arctic.table.TableMetaStore.call(TableMetaStore.java:239) at com.netease.arctic.table.TableMetaStore.doAs(TableMetaStore.java:207) at com.netease.arctic.server.terminal.TerminalSessionContext$ExecutionTask.get(TerminalSessionContext.java:196) at com.netease.arctic.server.terminal.TerminalSessionContext$ExecutionTask.get(TerminalSessionContext.java:171) at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1812) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) at java.base/java.lang.Thread.run(Thread.java:1575) Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.apache.spark.SparkConf$ at org.apache.spark.SparkConf.set(SparkConf.scala:94) at org.apache.spark.SparkConf.set(SparkConf.scala:83) at org.apache.spark.SparkConf.setAppName(SparkConf.scala:120) at com.netease.arctic.server.terminal.local.LocalSessionFactory.lazyInitContext(LocalSessionFactory.java:109) at com.netease.arctic.server.terminal.local.LocalSessionFactory.create(LocalSessionFactory.java:57) at com.netease.arctic.server.terminal.TerminalSessionContext.lazyLoadSession(TerminalSessionContext.java:165) at com.netease.arctic.server.terminal.TerminalSessionContext.access$200(TerminalSessionContext.java:40) at com.netease.arctic.server.terminal.TerminalSessionContext$ExecutionTask.lambda$get$0(TerminalSessionContext.java:198) at com.netease.arctic.table.TableMetaStore.call(TableMetaStore.java:234) ... 7 more Caused by: java.lang.ExceptionInInitializerError: Exception java.lang.ExceptionInInitializerError [in thread "terminal-execute-1"] at org.apache.spark.unsafe.array.ByteArrayMethods.(ByteArrayMethods.java:54) at org.apache.spark.internal.config.package$.(package.scala:1095) at org.apache.spark.internal.config.package$.(package.scala) at org.apache.spark.SparkConf$.(SparkConf.scala:654) at org.apache.spark.SparkConf$.(SparkConf.scala) ... 16 more

245Bluesky avatar Apr 01 '25 06:04 245Bluesky

Hi, what JDK version are you using?

zhoujinsong avatar Apr 24 '25 11:04 zhoujinsong

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

github-actions[bot] avatar Oct 22 '25 00:10 github-actions[bot]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'

github-actions[bot] avatar Nov 05 '25 00:11 github-actions[bot]