aadant
aadant
stack trace involving shyiko : ``` "blc-fpif1-txnrepodbl1:3306" #77 prio=5 os_prio=0 cpu=3406817.79ms elapsed=71952.46s tid=0x00007feb4423f7a0 nid=0x11a runnable [0x00007feb5affd000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.FileDispatcherImpl.write0([email protected]/Native Method) at sun.nio.ch.SocketDispatcher.write([email protected]/SocketDispatcher.java:62) at sun.nio.ch.NioSocketImpl.tryWrite([email protected]/NioSocketImpl.java:398) at sun.nio.ch.NioSocketImpl.implWrite([email protected]/NioSocketImpl.java:413) at sun.nio.ch.NioSocketImpl.write([email protected]/NioSocketImpl.java:440) at...
It happens in the context of debezium embedded (Altinity sink connector). The problem occurs several times a week. There is an open issue there. It is a random issue though.
@osheroff I got a case that I suspect is a deadlock when the connection reconnects. Workaround is to restart.
@ZlobnyiSerg if the source is MySQL you can do the initial bulk load as consistent snapshot. See the python directory for utilities. I transferred 28TB in a couple of hours,...
@subkanthi there are parameters to tune to insert throughput (https://github.com/Altinity/clickhouse-sink-connector/issues/576)
Insert performance is pretty good, I got several MB/s with ``` # Max number of records for the flush buffer. buffer.max.records: "1000000" # Maximum number of threads in the thread...
@Jimerson21 I would recommend to take a snapshot using mysqlshell. we have toolings to do that. Then replication from the snapshot position. It is much more efficient to dump and...
Large events may lead to this message ``` ERROR io.debezium.pipeline.ErrorHandler - Producer failure io.debezium.DebeziumException: log event entry exceeded max_allowed_packet; Increase max_allowed_packet on master; the first event 'binary.085408' at 388427867, the...
looks like a duplicate of this one https://github.com/dbeaver/dbeaver/issues/21619
@E1izabeth indeed, disabling date formatting worked around the issue. What is wrong in my context ? ClickHouse process timezone is America/Chicago and DBeaver runs in the same timezone.