storm-contrib icon indicating copy to clipboard operation
storm-contrib copied to clipboard

TransactionalTridentKafkaSpout works correctly in local cluster, but fails to get any message in remote cluster

Open philipgao opened this issue 11 years ago • 4 comments

I am using TransactionalTridentKafkaSpout and transactional trident state, it works correctly in local cluster, but fails to get any message when I deploy it to a remote cluster

In both local cluster and remote cluster I am pointing TransactionalTridentKafkaSpout to the same zookeeper and kafka, really not know how this can possibly happen

philipgao avatar Apr 01 '13 17:04 philipgao

Code Sample is as below:

TridentKafkaConfig tridentKafkaConfig = new TridentKafkaConfig(new ZkHosts(zkServer+":"+zkPort, zkBrokerPath), kafkaTopic); tridentKafkaConfig.forceStartOffsetTime(-1);

TridentTopology topology=new TridentTopology(); TridentState tridentState = topology.newStream("kafkaSpout"+System.currentTimeMillis(), new TransactionalTridentKafkaSpout(tridentKafkaConfig)) .parallelismHint(10)

philipgao avatar Apr 01 '13 17:04 philipgao

I also tried clean all zookeeper data, seems not working

philipgao avatar Apr 01 '13 17:04 philipgao

I'm having the same problem. Have you figured out the solution?

danielpizarro avatar Jun 06 '13 20:06 danielpizarro

I also have the same problem. who can help me solve this?

wanwanqunqun avatar Apr 22 '15 08:04 wanwanqunqun