Burrow reporting topics that were deleted from Kafka

[jermbop]

Issue we are seeing: Our instance of Burrow is based on commit f3659d121a36fb9ebfd2519c024a132260323bb0 We deleted N number of topics from Kafka Requests to /v3/kafka/{cluster-name}/topic still return those deleted topics.

Besides setting topic-refresh, is there another configuration we are missing or have mis-configured causing burrow to retain deleted topics?

We have the following configuration

`[general] pidfile="burrow.pid" stdout-logfile="burrow.out"

[logging] filename="logs/burrow.log" level="info" maxsize=100 maxbackups=30 maxage=30 use-localtime=false use-compression=true

[zookeeper] servers=["10.10.X.X:2181", "10.10.Y.Y:2181", "10.10.Z.Z:2181"] timeout=6 root-path="/burrow"

[client-profile.client] kafka-version="0.10.2.0" client-id="burrow-client"

[cluster.prod-kafka] class-name="kafka" client-profile="client" servers=["10.10.A.A:9092", "10.10.B.B:9092", "10.10.C.C:9092", "10.10.D.D:9092", "10.10.E.E:9092", "10.10.F.F:9092"] topic-refresh=60 offset-refresh=10

[consumer.production] class-name="kafka" cluster="prod-kafka" servers=["10.10.A.A:9092", "10.10.B.B:9092", "10.10.C.C:9092", "10.10.D.D:9092", "10.10.E.E:9092", "10.10.F.F:9092"] zookeeper-path="/local" zookeeper-timeout=30 group-blacklist="^(console-consumer-).*$" group-whitelist=""

[evaluator.mystorage] class-name="caching" expire-cache=60

[storage.default] class-name="inmemory" workers=20 intervals=10 expire-group=604800 min-distance=60

[httpserver.default] address=":8080"`

[toddpalino]

I think you're going to need to pick up a more recent version. There are some issues in the Sarama client that made it difficult to properly handle deleted topics when doing metadata fetches.

[jmilagroso]

Tried master branch.

Experiencing same issue. OS: centos-release-7-7.1908.0.el7.centos.x86_64 Go: go version go1.12 linux/amd64 Kafka: 2.2.1

Encountered the same issue.

Steps to replicate:

1. Create kafka topic
2. Delete kafka topic
3. Check Burrow list topics

Current Behavior: -Topic deleted in kafka -Deleted topic still displayed in burrow

Expected Behavior: -Topic deleted in kafka -Deleted topic should not be displayed in burrow