pulsar icon indicating copy to clipboard operation
pulsar copied to clipboard

[Pulsar Sql] The number of query result records of pulsar SQL is less than that sent by producer

Open xuesongxs opened this issue 4 years ago • 7 comments

Describe the bug Pulsar version 2.6.2

The number of query result records of pulsar SQL is less than that sent by producer. 1、Producer sends 7 records; image 2、Pulsar SQL only queries 4 records; sql: select * from XXX; image

3、Topic has no subscription;

xuesongxs avatar Jun 30 '21 01:06 xuesongxs

Could you provide a simple example to describe this problem in detail? @xuesongxs

mattisonchao avatar Jun 30 '21 08:06 mattisonchao

Could you provide a simple example to describe this problem in detail? @xuesongxs

@mattisonchao The producer sent seven records to topic, but only four records were found by pulsar SQL, Look at the picture above.

xuesongxs avatar Jul 01 '21 01:07 xuesongxs

I have the same problem

chgxtony avatar Sep 01 '21 03:09 chgxtony

@xuesongxs have you checked with pulsar-admin topics stats <topic-name> or bookkeeper shell ledger to make sure entries do exist in BookKeeper? If not filtering by publish_time then default behavior is read all entries in a topic, the connector won't filter out or swallow any entry.

MarvinCai avatar Sep 18 '21 12:09 MarvinCai

pulsar-admin topics stats

I have checked with pulsar-admin topics stats ,indeed, the number of records found by pulsar SQL is less than the number of records written by the producer.

xuesongxs avatar Sep 22 '21 01:09 xuesongxs

The issue had no activity for 30 days, mark with Stale label.

codelipenghui avatar Mar 04 '22 06:03 codelipenghui

me too, v3.0.x

huxiyu avatar Jun 19 '24 07:06 huxiyu