paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[Bug] when table set deletion-vectors.enabled =true, call query_service error.

Open herefree opened this issue 1 year ago • 0 comments

Search before asking

  • [X] I searched in the issues and found nothing similar.

Paimon version

1.0

Compute Engine

flink 1.18

Minimal reproduce step

CREATE TABLE query_service_t (id INT, name STRING,PRIMARY KEY (id) NOT ENFORCED) with(
'bucket' = '1',
 'deletion-vectors.enabled' = 'true'
);

INSERT INTO query_service VALUES (1, 'a_new1'), (3, 'c_new1'); 3. call sys.query_service('tmp_rt.query_service_t',1);

What doesn't meet your expectations?

2024-09-26 17:04:18 java.lang.IllegalStateException: SortedRun is not sorted and may contain overlapping key intervals. This is a bug. at org.apache.paimon.utils.Preconditions.checkState(Preconditions.java:182) at org.apache.paimon.mergetree.SortedRun.validate(SortedRun.java:90) at org.apache.paimon.mergetree.SortedRun.fromUnsorted(SortedRun.java:67) at org.apache.paimon.mergetree.Levels.updateLevel(Levels.java:190) at org.apache.paimon.mergetree.Levels.update(Levels.java:161) at org.apache.paimon.table.query.LocalTableQuery.refreshFiles(LocalTableQuery.java:134) at org.apache.paimon.flink.service.QueryExecutorOperator.processElement(QueryExecutorOperator.java:113) at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:237) at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:146) at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:110) at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65) at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:562) at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231) at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:858) at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:807) at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:953) at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:932) at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:746) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562) at java.lang.Thread.run(Thread.java:748)

Anything else?

No response

Are you willing to submit a PR?

  • [ ] I'm willing to submit a PR!

herefree avatar Sep 26 '24 09:09 herefree