melin

Results 162 comments of melin

https://www.cnblogs.com/sheng-sjk/p/10624958.html

This parameter addition does not take effect, passed to debezium is a list of table names, the new table is not in the list. Moreover, flink cdc regular and debezium...

> Perhaps we can first add a generic catalog in the relational catalog to replace HMS. This generic catalog will persist metadata to Gravitino's backend storage, such as MySQL or...

unitycatalog 自己把table metadata存起来,不依赖外界metastore,Gravitino 使用场景会更广。希望尽快支持此功能。 我们是做数据中台厂商的,不同客户用会 aliyun dlf, glue catalog, hms, google metastore等产品。希望有一个中立的,有影响力的产品替代这些 metastore 产品。而不是在这些 metastore 基础上,再套一层gravitino。这样对我们产品接入和运维太复杂了。 https://github.com/unitycatalog/unitycatalog/blob/b141f19665c0c88ed6b72a04149881690ac29dcd/server/src/main/java/io/unitycatalog/server/persist/TableRepository.java#L108 @yuqi1129 @mchades @FANNG1

> So, can Gravitino replace HMS now? > The metadata is maintained by Gravitino oneself. 现在不可以

API 变化了,TableData 已经不存在了。具体参考一下Test: https://github.com/melin/superior-sql-parser/blob/master/superior-spark-parser/src/test/kotlin/io/github/melin/superior/parser/spark/SparkSqlParserTest.kt

1、如你所说的使用 2、可以支持的,这两天添加一下。

> @melin 大佬,我测了下上面的with语句,解析是解析出来了,目标路径也有,但是outputTables没有值,就是没有获取到with里面真正查询的表,这个能支持吗 更新了,再试试