paimon
paimon copied to clipboard
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
### Purpose Linked issue: close #5110 ### Tests ### API and Format ### Documentation
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version paimon-1.0.1 ### Compute Engine hive-3.1.2 spark-3.5.1 ### Minimal reproduce step step 1:...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version  ``` 3.5.2: java.lang.ArrayIndexOutOfBoundsException: 1 at org.apache.spark.sql.types.StructType.apply(StructType.scala:407) at org.apache.spark.sql.catalyst.expressions.GetStructField.toString(complexTypeExtractors.scala:118) at java.lang.String.valueOf(String.java:2994) at...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation I have a Flink Generic Catalog which Hive Metastore. But i want to...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version 0.9.0 client ### Compute Engine starrocks ### Minimal reproduce step may https://github.com/StarRocks/starrocks/issues/54070...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Motivation When calling the getTable interface of HMS, if the server-side validation finds that...
### Purpose Currently, Paimon missing spark metadata desc after spark version > 3.3, and if we want support Spark DEFAULT VALUE, we also need metadata desc, so, this pr will...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version Paimon Version: 1.0.1 Storage: OSS ### Compute Engine Flink 1.20.1 ### Minimal...
### Purpose The problem is that the shell `update_branch_version.sh` cannot update the `paimon-flink1-common` and `paimon-flink2-common`. Solution is like spark: Spark3 depends both on paimon-spark3-common and paimon-spark-common, and the spark3 profile...
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version If my records come disorderly, -D record may have been compact out...