mypipe
mypipe copied to clipboard
mardambey
Found a Bug:values from one table are zipped with metadata from other tables.
Found that,some times values from one table are zipped with metadata of other tables.I'm trying to figure out this .In case if you can suggest me some possible places to look for this bug,it will be very helpful.
@bbnsumanth is there a specific revision that this started with? Can you give more information and an example?
Cheers (=
I don't think it crept in from a particular revision. I'm going through mypipe code and struck with figuring out where is this method findTable(tableId: java.lang.Long) from trait BinaryLogConsumer implemented.I couldn't find its implementation.Sorry if I'm missing some thing.Can you help me?
Sorry I have no clue to reproduce this.I found this when I'm reading messages from kafka.I'm pushing mutations of one table to one kafka topic with one partition.I found that some topics have messages with same table metadata but values of other tables.I'm guessing that this bug might have aroused when we are finding table obj using the method findTable(tableId) and table id we got from eventdata.
Can you Help me in finding out the implementation for the method findTable(tableId: java.lang.Long) from trait BinaryLogConsumer
@bbnsumanth any movement here? Can you reproduce? If you need help, let me know. Do you still need an answer for the above?
I found the same problem. the error log: 18:25:17.551 [ForkJoinPool-3-worker-3] ERROR m.m.ConfigBasedErrorHandler - Could not handle 2714 mutation(s) from listener mypipe.pipe.Pipe$$anon$5@541e79ad 18:25:17.552 [ForkJoinPool-3-worker-3] ERROR m.m.MySQLBinaryLogConsumer - Consumer database-medusa failed to process event Some(XidEvent(453616)) from Event{header=EventHeaderV4{timestamp=1518053646000, eventType=XID, serverId=321184, headerLength=19, dataLength=8, nextPosition=1806837, flags=0}, data=XidEventData{xid=453616}} 18:25:17.552 [ForkJoinPool-3-worker-3] ERROR m.m.ConfigBasedErrorHandler - Could not handle event Some(XidEvent(453616)) from raw event Event{header=EventHeaderV4{timestamp=1518053646000, eventType=XID, serverId=321184, headerLength=19, dataLength=8, nextPosition=1806837, flags=0}, data=XidEventData{xid=453616}} 18:25:17.552 [ForkJoinPool-3-worker-3] INFO m.p.Pipe - Pipe kafka-specific-pipe disconnected! 18:25:18.545 [ForkJoinPool-3-worker-11] ERROR m.p.KafkaMutationSpecificAvroProducer - failed to queue: Not in union ["long","null"]: 0.37689903
the avro schema is ok.but the table is not the one that I have defined. even the table is not int ${include-event-condition}.
