melin

The DropHoodieTableCommand class calls invalidateCachedTable with the QualifiedTableName object passed as the parameter. The FullQualifiedTableName class was added in spark 3.5.3. The invalidateCachedTable method supports only FullQualifiedTableName and TableIdentifier. The...

Your code will work. idea breakpoint debugging, DropHoodieTableCommand run method is not entered, I guess the hive catalog is not used, the execution is different.

Can we refer to Paimon's solution for integrating Glue? https://github.com/apache/paimon/pull/4283/files#diff-534e1f558f31481abfd234e3b9c56c17a0988acf360a2264b0a090fa3a6aedd5 https://issues.apache.org/jira/browse/FLINK-38457 @FranMorilloAWS

> s3 files The S3 file does not support appending for writing. How is the append writing implemented? Or should we perform a full write coverage at regular intervals (for...

@ChenYi015 Has the community considered this feature? Just like Hadoop YARN, it has the ability to aggregate logs.

My main consideration is to have an "out-of-the-box" feature that doesn't require overly complicated operations. Just need to configure ak/sk, endpoint and logpath. The data warehouse uses Spark for ETL...

In the spark-jobserver project, first initialize the sparkSession in the Java code, and then execute the Python script. The Python script use py4j to obtain the sparkSession that was created...

> Hi [@melin](https://github.com/melin) -- we need to use init_spark to make sure Spark is using Ray as the scheduler. What is your use case? Can ray support it?

@Cythia828 +1 @JackWang032

非常感谢详细的解惑，还有一个问题请求，混部的时候，交换机网络 QoS需要考虑吗？怎么避免交换机巨大流量影响在线业务？