conduit icon indicating copy to clipboard operation
conduit copied to clipboard

[The Pipeline detail screen]  400 error is handled when creating the Kafka Destination connector with optional configuration ...

Open uchennakevinm1 opened this issue 2 years ago • 4 comments

[The Pipeline detail screen]  400 error is handled when creating the Kafka Destination connector with optional configuration "acks": "0" or "acks": "1" Bug is only reproduced when using the UI conduit   Additional info: We can create the Kafka Destination connector with optional configuration "acks": "0" or "acks": "1" by using Postman

Logs: 2022-05-06T15:37:53+00:00 ERR error processing HTTP request error="rpc error: code = InvalidArgument desc = proto:\u00a0(line 1:167): invalid value for string type: 0" http_endpoint="POST /v1/connectors" request_id=44de8178-6732-4967-a264-792fc8c4aa71 stack=null 2022-05-06T15:39:10+00:00 ERR error processing HTTP request error="rpc error: code = InvalidArgument desc = proto:\u00a0(line 1:167): invalid value for string type: 1" http_endpoint="POST /v1/connectors" request_id=7f409e72-c3db-41df-a6d6-4d7d5155b06f stack=null

uchennakevinm1 avatar Aug 25 '22 00:08 uchennakevinm1

@uchennakevinm1 @hariso I am unable to reproduce this, can we confirm this is still an issue with a proper kafka setup?

jmar910 avatar Sep 26 '22 16:09 jmar910

Same here with postgres destination. I tried to fill table field. изображение Log from the container:

2023-08-31T16:50:23+00:00 ERR error processing HTTP request error="rpc error: code = InvalidArgument desc = proto:\u00a0(line 1:139): invalid value for string type: {" http_endpoint="PUT /v1/connectors/bf462fea-1d1d-48cd-b46a-de1a6d7a0d41" request_id=7e257f83-dc5b-4244-b5c3-50323dcad0e5 stack=null

artemklevtsov avatar Aug 31 '23 16:08 artemklevtsov

@artemklevtsov Thanks for the details! Which version of Conduit are you running?

Based on the logs which you've shown, it looks like the UI is getting confused by the parameter names. The configuration should have:

{
  "sdk.record.format": "debezium/json"
}

and not:

{
  "sdk.record": {
    "format": "debezium/json"
  }
}

Meanwhile, if this is a blocker for you, I can suggest using a pipeline configuration file. That should definitely work.

hariso avatar Sep 01 '23 09:09 hariso

@artemklevtsov Thanks for the details! Which version of Conduit are you running?

Latest stable release: e.g. v0.7.2.

artemklevtsov avatar Sep 01 '23 18:09 artemklevtsov