Shixiong Zhu

Results 193 comments of Shixiong Zhu

Thanks for opening the ticket. We will visit this when #85 is done.

cc @YannByron as you would like to build this. We can start from INSERT INTO support.

@spmp thanks for raising this. We would need to push the syntax to Hive so that the connector can use it, similar to the Spark PR. Could you raise a...

@huaxingao Thanks for the information. Will try it when Hive 4.0.0 is out.

@spmp I haven't looked at what is done by https://issues.apache.org/jira/browse/HIVE-25344. I'd suggest you to look at what interface added by Hive and see if Delta can plugin its code to...

- DeltaLog.getChanges: Yes. - Snapshot.getAllFiles: No. We don't want to add the guarantee so that we can optimize how to read transaction logs. - DeltaScan.getFiles: No. We don't want to...

> e.g. reading deterministic actions through an iterator could be useful for failure recovery for the Flink Source connector. This means we need to sort by something before returning the...

> if `listFiles` returns them in order ... and we read each action in the .json file line by line ... shouldn't that guarantee deterministic order? For example, a snapshot...

Hive doesn't allow `ALTER TABLE` on a non-native table: ``` org.apache.hadoop.hive.ql.parse.SemanticException: ALTER TABLE cannot be used for a non-native table deltatbl at org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.validateAlterTableType(DDLSemanticAnalyzer.java:1354) at org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.addInputsOutputsAlterTable(DDLSemanticAnalyzer.java:1533) at org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.addInputsOutputsAlterTable(DDLSemanticAnalyzer.java:1479) at org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeAlterTableRenameCol(DDLSemanticAnalyzer.java:2661) at...

The doc in https://github.com/delta-io/delta-sharing#azure-blob-storage shows how to set a Hadoop configuration. Could you try to use the same approach to set `fs.s3a.endpoint`. It's talking about how to set Azure credentials...