kafka-backup

kafka-backup copied to clipboard

detect empty topics during snapshot mode backup

istvan-m

Have created strimzi cluster and created 2 topics and produced messages to respective topics and took backup called backup-1. so the backup-1 would contains 2 topics along with messages. And...

shanmukha511

the backup keep looping with flushed topic forever

3

Thanks guy, it works but I got another issue with looping forever when running backup in the lastest master branch command running Hi @itadventurer ``` backup-standalone.sh --snapshot --bootstrap-server http://kafka-stg.default.svc.cluster.local:9092 --target-dir...

huyngopt1994

Restore issue for a topic with multiple partitions

1

Hi, we're having issues in restoring topics with multiple partitions. _kafka version: 2.6.0_ I'm backing up topic 2nd_topic using the docker version of the component using this command: ``` docker...

alessio-torelli

Sink: Decouple sync of offsets with the `put()` function

4

Ideally this job would be scheduled independently of the delivery of new messages from Kafka Connect. Currently the offsets are synchronized every time, new records are pushed to Kafka Connect.

itadventurer

Hi, I am currently unable to do restore and restore-standalone.sh keeps throwing this error. ``` ERROR WorkerSourceTask{id=backup-source-0} Failed to flush offsets to storage: (org.apache.kafka.connect.runtime.WorkerSourceTask) org.apache.kafka.connect.errors.DataException: ByteArrayConverter is not compatible with...

chetannarasimhaiah

Hi, maybe this is dumb question, but i cannot understand how to pass a _regex_ to `backup_standalone.sh` script. I'm trying to run the kafka-backup tool on Kubernetes, the pod shows...

paoloyx

error: Offsets must be always increasing! There is something terribly wrong in your index!

2

I have a deployment with this error: > Offsets must be always increasing! There is something terribly wrong in your index! What is the exact meaning of this error?

andresgomezfrr

"consumer poll timeout has expired" loop (was "kafka-backup may fail due to slow disk IO")

18

Just found this in logs today. Kafka-backup seems stuck in offsets resetting loop after restart because of this. ``` [2020-05-30 08:48:37,022] INFO [Consumer clientId=connector-consumer-chrono_prod-backup-sink-0, groupId=connect-chrono_prod-backup-sink] Member connector-consumer-chrono_prod-backup-sink-0-4bcd6afc-19a0-4458-b708-ded84fc567a3 sending LeaveGroup request...

jay7x

Backup & Restore Topic configuration

1

Currently we rely on a Zookeeper restore or manual creation of topics to be restored. Instead, it would be nice to be able to restore not only the topic data...

itadventurer