conduit icon indicating copy to clipboard operation
conduit copied to clipboard

Run two identical source connectors with the same config in one pipeline?

Open uchennakevinm1 opened this issue 2 years ago • 0 comments

Is it normal to run two identical source connectors with the same config in one pipeline? We have two example behavior: 1 two identical File source connectors - the error isn't occurred and data is transferred 2 S3 Source connector - the error is occurred (see logs)

Logs: ERR node stopped error="node 8785f29c-0357-47c4-925d-e9b6accac608 stopped with error: encountered two records with the same position ("0.0")" component=pipeline.Service node_id=8785f29c-0357-47c4-925d-e9b6accac608 stack=[{"file":"/Users/serhii/conduit/pkg/pipeline/lifecycle.go","func":"github.com/conduitio/conduit/pkg/pipeline.(*Service.runPipeline.func1","line":387},{"file":"/Users/serhii/conduit/pkg/pipeline/stream/acker.go","func":"github.com/conduitio/conduit/pkg/pipeline/stream.(*AckerNode.ExpectAck","line":179}]

uchennakevinm1 avatar Aug 26 '22 02:08 uchennakevinm1