Retrieve message of a queue create after the subscription

[manang]

Description

The application does not see the messages of a topic created after the subscription, putting as parameter a regex

How to reproduce

On kafka, create a topic named test1

subscribe to a topic with regex ".test*"

On kafka, create a topic named test2

write a message on test1 -> the consumer application receives the message write a message on test2 -> the consumer application does not receive the message

Checklist

Please provide the following information:

• [ x] confluent-kafka-go and librdkafka version (LibraryVersion()): 1.9.2
• [ x] Apache Kafka broker version:bin 7.5.1-ccs
• [x ] Client configuration: ConfigMap{...}

 configMap := &kafka.ConfigMap{
		"bootstrap.servers":   broker,
		"group.id":            groupID,
		"auto.offset.reset":   "earliest",
		"metadata.max.age.ms": "1000",
	}

• [ x] Operating system: mac os 14 for the client, linux for the server
• [ ] Provide client logs (with "debug": ".." as necessary)
• [ ] Provide broker log excerpts
• [ ] Critical issue

[milindl]

Hi @manang , is it possible to attach the debug logs as well as the code used for subscribing? For the debug logs you can use "debug": "all" inside the ConfigMap.

[mayanksingh2298]

hi @manang.. I am in the same situation as you. Try setting the property topic.metadata.refresh.interval.ms instead of metadata.max.age.ms.

That should do it,