Daniel
Daniel
If it helps anyone, we got the following to work in a file that references shared security settings: ``` components: securitySchemes: Basic_Authentication: $ref: 'https://your-public-url/auth.yml#/components/securitySchemes/Basic_Authentication' ``` and then defining ``` security:...
Hi @Jootoi could you specify the versions you're seeing an issue with?
Hi @dinegri records are appended to temp files as they arrive, not kept in memory. The temp files are then moved to the final path if **one or more** of...
> I attempted running the connector using Hadoop 2.7.7 (I just updated the pom.xml to use Hadoop 2.7.7 and then rebuilt it with the new dependencies). We still saw this...
@grantatspothero Our fix https://github.com/confluentinc/kafka-connect-storage-cloud/pull/377 is out and will be merged ASAP.
Hi @swathimocharla thanks for raising the issue, on a first pass it sounds like the handling for `parquet` format is different from the `avro` format. `hiveMetaStore.alterTable(table);` is used in the...
Hi @swathimocharla could you share which hadoop and hive version you are using?
Hi @swathimocharla this connector is compatible with `Hadoop 2.x` and `Hive 2.x`, could you try our HDFS3 connector and see if it resolves your issue? https://docs.confluent.io/kafka-connect-hdfs3-sink/current/index.html
Hi @swathimocharla I believe the difference in behavior between the `AVRO` and `Parquet` formats is that we apply the `avro schema` [here](https://github.com/confluentinc/kafka-connect-hdfs/blob/0c66e6dbef2670d28979ec1307f00d7419249b56/src/main/java/io/confluent/connect/hdfs/avro/AvroHiveUtil.java#L74) before altering the table. I think it would...
Thanks @hariprasad-k for the contribution! This change will add flexibility to our connectors that use storage common to optionally exclude the topic name from the path (seems to be a...