inlong
inlong copied to clipboard
[Bug][DataProxy] DataProxy is not sending data to Pulsar
What happened
dp is not sending data to pulsar.
What you expected to happen
There is a record of data consumption in pulsar, and the last data generated in clickhouse.
How to reproduce
When I finished the approval and kept adding data to the local source file, no data was generated in clickhouse. Finally, after finding the problem, I found that there was no data in pulsar.
Environment
centos 7
InLong version
master
InLong Component
InLong DataProxy
Are you willing to submit PR?
- [X] Yes, I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
Message has been sent to dp? and If the message has been sent to dp, please confirm whether the expected topic configuration information is contained in conf/topics.properties,
In addition, please check whether the log contains the following information。
@baomingyu
There is this error in inlong-dataproxy/logs/.
Please check if this topic exists in the pulsar cluster. and check the initial configuration steps of the cluster. If the initial configuration information of the cluster in the Manager is incorrect, the topic may not be created in advance.
@baomingyu There is a corresponding topic in pulsar, but the topic always shows no data consumption
this issue may be the same with https://github.com/apache/inlong/issues/5163, and we will look into it.
fixed in https://github.com/apache/inlong/pull/5189. Please check again.
When I use the latest code, I still can't get the data to pulsar, and new errors occurs.
这个问题你是否已经解决?我碰到了同样的问题,束手无策。1.4.0版本
This issue is stale because it has been open for 60 days with no activity.
@ly100120 please add the steps to reproduce the issue.