shidayang

Results 25 comments of shidayang

@haoch thanks,I also have a question. can siddhi resolve unsort event?

> 目前hudi社区也已经有元数据管理服务,也提供接口,现在是不是对接管理开发也更容易了,能不能加快一下排期呢? We are very interested in integrating Hudi. Are you interested in driving this feature?

I found the parquet schema is incorrect. The incorrect is like: ``` Created by: parquet-mr version 1.12.3 (build f8dced182c4c1fbdec6ccb3185537b5a01e6ed6b) Properties: iceberg.schema: {"type":"struct","schema-id":0,"fields":[{"id":1,"name":"orgid","required":false,"type":"string"},{"id":2,"name":"time_stamp","required":false,"type":"string"},{"id":3,"name":"userid","required":false,"type":"string"},{"id":4,"name":"legduration","required":false,"type":"int"},{"id":5,"name":"call_id","required":false,"type":"string"},{"id":6,"name":"locus","required":false,"type":"string"},{"id":7,"name":"start_time","required":false,"type":"string"},{"id":8,"name":"uatype","required":false,"type":"string"},{"id":9,"name":"devicetype","required":false,"type":"string"},{"id":10,"name":"uaversion","required":false,"type":"string"},{"id":11,"name":"crid","required":false,"type":"string"},{"id":12,"name":"source","required":false,"type":"string"},{"id":13,"name":"has_audio","required":false,"type":"boolean"},{"id":14,"name":"has_video","required":false,"type":"boolean"},{"id":15,"name":"dataid","required":false,"type":"string"},{"id":16,"name":"relation_name","required":false,"type":"string"},{"id":17,"name":"pdate","required":false,"type":"string"}]} Schema: message table { optional binary orgid (STRING)...

Design doc:https://docs.google.com/document/d/1CwvXGt--MZG9XcqN-Q4scqoLerGcY6seIgAOhPVv2BM/edit?usp=sharing

Discussed in https://github.com/NetEase/arctic/discussions/494

Design document: https://cwiki.apache.org/confluence/display/PAIMON/PIP-8%3A+Introduce+listeners+for+Paimon

Trino already supports querying the base table. like `select * from {tableName}#base`. reference:https://arctic.netease.com/ch/mpp/trino/#basestore Is there any extra work to do?