terraform-provider-kafka-connect icon indicating copy to clipboard operation
terraform-provider-kafka-connect copied to clipboard

Increase timeout

Open kinghuang opened this issue 5 years ago • 5 comments

Is there a way to increase the timeout for creating/updating connectors? Kafka Connect can take a really long time when processing lots of connectors. I keep getting errors like this:

Error: error code: 500 , message: IO Error trying to forward REST request: java.net.SocketTimeoutException: Connect Timeout

  on main.tf line 55, in resource "kafka-connect_connector" "oi":
  55: resource "kafka-connect_connector" "oi" {

Re-running the apply a few times eventually finishes all the connectors.

kinghuang avatar Oct 08 '19 23:10 kinghuang

I'm also experiencing this - over 150 connectors, initial provisioning took more than 10 applies to complete.

ndobbs avatar Sep 08 '20 15:09 ndobbs

Hello, thanks for your work on this connector. Do you think it would be worth to add an option to increase this timeout?

piotr-yuxuan avatar May 17 '21 09:05 piotr-yuxuan

Hi, Definitely yes. If creation time is bigger than 60 seconds timeout error is returned even if a connector is created. Next execution fails because the topic already exists and should be deleted manually. It would be great to have timeout option as a parameter that should be passed to provider.

alexkonkin avatar Dec 22 '21 09:12 alexkonkin

Happy to have a look at this if I have some time.

piotr-yuxuan avatar Dec 24 '21 12:12 piotr-yuxuan