hudi icon indicating copy to clipboard operation
hudi copied to clipboard

Executor executes action [initialize instant ] error

Open mtzcsc opened this issue 1 year ago • 5 comments

Tips before filing an issue

  • Have you gone through our FAQs?

  • Join the mailing list to engage in conversations and get faster support at [email protected].

  • If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced

A clear and concise description of the problem.

To Reproduce

Steps to reproduce the behavior:

1.CREATE TABLE t10( id int, num int, ts int, primary key (id) not enforced ) PARTITIONED BY (num) with( 'connector'='hudi', 'path' = 'hdfs://192.168.144.131:9000/hudi/t10', 'table.type'='COPY_ON_WRITE', 'hive_sync.enable'='true', 'hive_sync.table'='h10', 'hive_sync.db'='hudi', 'hive_sync.mode' = 'hms', 'hive_sync.metastore.uris' = 'thrift://192.168.144.131:9083' );insert into t10 values(1,1,1); 2. 3. 4.

Expected behavior

1.通过flinksql创建hudi表并且同步到hive

Environment Description

  • Hudi version :0.13.1

  • Spark version :

  • Hive version :3.1.3

  • Hadoop version :3.3.6

  • Storage (HDFS/S3/GCS..) :

  • Running on Docker? (yes/no) :no

Additional context

Add any other context about the problem here.

Stacktrace

flink-root-standalonesession-15-localhost.localdomain.log

mtzcsc avatar Aug 27 '24 01:08 mtzcsc

Caused by: org.apache.hudi.exception.HoodieRollbackException: Found commits after time :20240826180054702, please rollback greater commits first

You need to rollback the greater commit first based on the prompt.

By the way, it may not be the root cause of the exception, my speculation is there is other errors that trigger frequent rollback of the job or multi writers.

danny0405 avatar Aug 27 '24 04:08 danny0405

Caused by: org.apache.hudi.exception.HoodieRollbackException: Found commits after time :20240826180054702, please rollback greater commits first

您需要先根据提示回滚更大的提交。

顺便说一句,这可能不是异常的根本原因,我的推测是还有其他错误会触发作业或多写入器的频繁回滚。

还有什么原因会导致这个问题 我看之前也有类似的问题 但是好像是0.10.0版本

mtzcsc avatar Aug 27 '24 06:08 mtzcsc

There could be multiple reasons: multi-writer without lock provider configured or other exceptions that trigger frequent rollback.

danny0405 avatar Aug 27 '24 09:08 danny0405

可能有多种原因:未配置锁提供程序的多写入器或其他触发频繁回滚的异常。 Now it's an error, but there are still problems image

mtzcsc avatar Aug 27 '24 09:08 mtzcsc

Yeah, let's resolve this calcite-core jar missing issue.

danny0405 avatar Aug 28 '24 01:08 danny0405

Hi @mtzcsc

I hope your issue is resolved. If not, please let me or Danny know so we can help.

rangareddy avatar Aug 26 '25 13:08 rangareddy