conduit
conduit copied to clipboard
Run two identical source connectors with the same config in one pipeline?
Is it normal to run two identical source connectors with the same config in one pipeline? We have two example behavior: 1 two identical File source connectors - the error isn't occurred and data is transferred 2 S3 Source connector - the error is occurred (see logs)
Logs: ERR node stopped error="node 8785f29c-0357-47c4-925d-e9b6accac608 stopped with error: encountered two records with the same position ("0.0")" component=pipeline.Service node_id=8785f29c-0357-47c4-925d-e9b6accac608 stack=[{"file":"/Users/serhii/conduit/pkg/pipeline/lifecycle.go","func":"github.com/conduitio/conduit/pkg/pipeline.(*Service.runPipeline.func1","line":387},{"file":"/Users/serhii/conduit/pkg/pipeline/stream/acker.go","func":"github.com/conduitio/conduit/pkg/pipeline/stream.(*AckerNode.ExpectAck","line":179}]