storm-contrib
storm-contrib copied to clipboard
TransactionalTridentKafkaSpout works correctly in local cluster, but fails to get any message in remote cluster
I am using TransactionalTridentKafkaSpout and transactional trident state, it works correctly in local cluster, but fails to get any message when I deploy it to a remote cluster
In both local cluster and remote cluster I am pointing TransactionalTridentKafkaSpout to the same zookeeper and kafka, really not know how this can possibly happen
Code Sample is as below:
TridentKafkaConfig tridentKafkaConfig = new TridentKafkaConfig(new ZkHosts(zkServer+":"+zkPort, zkBrokerPath), kafkaTopic); tridentKafkaConfig.forceStartOffsetTime(-1);
TridentTopology topology=new TridentTopology(); TridentState tridentState = topology.newStream("kafkaSpout"+System.currentTimeMillis(), new TransactionalTridentKafkaSpout(tridentKafkaConfig)) .parallelismHint(10)
I also tried clean all zookeeper data, seems not working
I'm having the same problem. Have you figured out the solution?
I also have the same problem. who can help me solve this?