I got an error when I tried to add Minio to my source. i.a.w.i.VersionedAirbyteStreamFactory(internalLog):304 - Check failed

[vitaaaaa1]

Connector Name

source-s3

Connector Version

4.8.4

What step the error happened?

None

Relevant information

I used Helm to install Airbyte, and I first added a self-hosted Minio to the Destinations without any issues. However, when I tried to add Minio to the Sources using the same bucket host and secret_key, the installation failed.

I don't know where I went wrong. Can anyone help me?

this is config info

Adding minio to destination had no problems

Relevant log output

2024-10-11 07:55:59 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: CLAIM — (workloadId = 69589781-7828-43c5-9f63-8925b1c1ccc2_14f231ac-e125-43ed-9d5c-f8bae244c111_0_check) — (dataplaneId = local)
2024-10-11 07:56:07 INFO i.a.c.i.LineGobbler(voidCall):166 - 
2024-10-11 07:56:07 INFO i.a.c.i.LineGobbler(voidCall):166 - ----- START CHECK -----
2024-10-11 07:56:07 INFO i.a.c.i.LineGobbler(voidCall):166 - 
2024-10-11 07:56:07 INFO i.a.c.ConnectorWatcher(processConnectorOutput):114 - Connector exited, processing output
2024-10-11 07:56:07 INFO i.a.c.ConnectorWatcher(getConnectorOutputStream):151 - Output file jobOutput.json found
2024-10-11 07:56:07 INFO i.a.c.ConnectorWatcher(processConnectorOutput):117 - Connector exited with exit code 0
2024-10-11 07:56:07 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):189 - Reading messages from protocol version 0.2.0
2024-10-11 07:56:07 WARN i.a.m.l.MetricClientFactory(getMetricClient):43 - MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics.
2024-10-11 07:56:07 ERROR i.a.w.i.VersionedAirbyteStreamFactory(internalLog):304 - Check failed
2024-10-11 07:56:07 INFO i.a.c.ConnectorMessageProcessor(updateConfigFromControlMessage):231 - Checking for optional control message...
2024-10-11 07:56:07 INFO i.a.c.ConnectorMessageProcessor(updateConfigFromControlMessage):253 - Optional control message not found. Skipping...
2024-10-11 07:56:07 INFO i.a.c.ConnectorWatcher(saveConnectorOutput):162 - Writing output of 69589781-7828-43c5-9f63-8925b1c1ccc2_14f231ac-e125-43ed-9d5c-f8bae244c111_0_check to the doc store
2024-10-11 07:56:07 INFO i.a.c.ConnectorWatcher(markWorkloadSuccess):167 - Marking workload 69589781-7828-43c5-9f63-8925b1c1ccc2_14f231ac-e125-43ed-9d5c-f8bae244c111_0_check as successful
2024-10-11 07:56:08 INFO i.a.c.ConnectorWatcher(exitProperly):215 - Deliberately exiting process with code 0.
2024-10-11 07:56:08 INFO i.a.c.i.LineGobbler(voidCall):166 -

Contribute

• [X] Yes, I want to contribute

[jakeshivers]

In your top screenshot, did you click on add for "the list of streams to sync"? I just went through the same issue.

[dperconti]

I am seeing this error as well when trying to connect Linear with Airbyte:

2024-10-27 17:26:10 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: CLAIM — (workloadId = fd6dcd80-d569-4d83-90e3-10dfff48f393_80266e1e-434c-4792-bb34-08dfa0912ac9_0_check) — (dataplaneId = local)
2024-10-27 17:26:18 INFO i.a.c.i.LineGobbler(voidCall):166 - ----- START CHECK -----
2024-10-27 17:26:18 INFO i.a.c.ConnectorWatcher(getConnectorOutputStream):151 - Output file jobOutput.json found
2024-10-27 17:26:18 INFO i.a.c.i.LineGobbler(voidCall):166 - 
2024-10-27 17:26:18 INFO i.a.c.ConnectorWatcher(processConnectorOutput):117 - Connector exited with exit code 0
2024-10-27 17:26:18 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):189 - Reading messages from protocol version 0.2.0
2024-10-27 17:26:18 WARN i.a.m.l.MetricClientFactory(getMetricClient):43 - MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics.
2024-10-27 17:26:18 INFO i.a.c.ConnectorMessageProcessor(updateConfigFromControlMessage):231 - Checking for optional control message...
2024-10-27 17:26:18 INFO i.a.c.ConnectorMessageProcessor(updateConfigFromControlMessage):253 - Optional control message not found. Skipping...
2024-10-27 17:26:18 INFO i.a.c.ConnectorWatcher(saveConnectorOutput):162 - Writing output of fd6dcd80-d569-4d83-90e3-10dfff48f393_80266e1e-434c-4792-bb34-08dfa0912ac9_0_check to the doc store
2024-10-27 17:26:18 INFO i.a.c.ConnectorWatcher(markWorkloadSuccess):167 - Marking workload fd6dcd80-d569-4d83-90e3-10dfff48f393_80266e1e-434c-4792-bb34-08dfa0912ac9_0_check as successful
2024-10-27 17:26:18 INFO i.a.c.i.LineGobbler(voidCall):166 - 
2024-10-27 17:26:18 INFO i.a.c.ConnectorWatcher(exitProperly):215 - Deliberately exiting process with code 0.
2024-10-27 17:26:18 INFO i.a.c.i.LineGobbler(voidCall):166 - ----- END CHECK -----

[dperconti]

Potentially related ticket:

https://github.com/airbytehq/airbyte/issues/45873