incubator-xtable
incubator-xtable copied to clipboard
apache
Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.
Addresses #323 The DeltaClient target converts a dataFile's absolute path to a relative path by default. This behavior is usually desirable, as relative paths are more compatible with query engines....
Depends on: https://github.com/onetable-io/onetable/pull/320 Hudi Instructions > Note > StarRocks is having problems with Hudi query. See https://github.com/onetable-io/onetable/issues/319 ``` StarRocks > CREATE EXTERNAL CATALOG hudi_catalog_hms -> PROPERTIES -> ( -> "type"...
Following https://onetable.dev/docs/demo/docker/ with PR https://github.com/onetable-io/onetable/pull/320 Trying to query from starrocks ``` StarRocks > CREATE EXTERNAL CATALOG hudi_catalog_hms -> PROPERTIES -> ( -> "type" = "hudi", -> "hive.metastore.type" = "hive", ->...
To address [256](https://github.com/onetable-io/onetable/issues/256) and similar issues people have with environment setup having a docker playground will help.
Currently, any absolute paths of a `dataFile` is converter to relative path in the `DeltaClient` https://github.com/onetable-io/onetable/blob/69282bd27abefc4d52c45dca33965cb93fca228a/core/src/main/java/io/onetable/delta/DeltaDataFileUpdatesExtractor.java#L104 This conversion is hardcoded as `relative paths more commonly supported by query engines`. As...
## What is the purpose of the pull request Aims to address #297 ## Brief change log - Pass in a `Map` of client properties when initializing the source client...
Apache Paimon is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics. OneTable could adopt Paimon table format for streaming lakehouse.
Create a UUID type in OneType and handle it appropriately in all converters. Only Iceberg has a concept of a UUID and it is a fixed size byte array in...
This enhancement request stems from 1) the conversation in #293 and 2) emerging needs such as #296. The intent is to clean up the `PerTableConfig`. OneTable's sync flow is based...
According to https://github.com/onetable-io/onetable/issues/262 Docs needs to clarify 1. DB names appropriately i.e. instead of `onetable_synced_db` call it `onetable_synced_delta_db` (same for hudi and iceberg as well) 2. Command to create the...