ziyangRen

 The execution result is as above. Rows containing null values are extra data

@zhouyuan We have found the cause of this problem: we have configured spark. oap. sql. columnar. hashagg. support String=true, when aggregating String type fields, when aggregating String type fields, it...

Thank you for your reply ! @YichuanSun I used 2.9.3 @jasondrogba I tried to check the metadata using checkConsistency, but it was no different from UFS, and my manual loadMetaData...

In addition, the write to the file is a spark2.4.8 connection to hive write (the hive table metadata points to alluxio), and the alluxio log before and after the file...

@jasondrogba Of course, I'll share more logs, the following two logs show up repeatedly in master.log.Note that all files in /user/hive/warehouse/edw_user.db/adm_cs_device_tag_df/batch=20240416 will get the same two alerts ``` 2024-04-17 03:58:41,516...

@jasondrogba hi, did you forget this issue, and the problem still exists. If possible, please help to confirm whether this is a bug and how to solve it. If you...

hi @jasondrogba I tried my best to gather the worker logs and didn't find any errors, but I've tried to summarize a few recurring events from that time that might...

@jasondrogba Thanks for your quick reply. But if you say this is the case, I have three questions: 1. I can understand the data miss due to lack of SSD...

@jasondrogba Thanks again for your patience, but I still have some questions about the previous question: 1. I manually synched the metadata and it didn't work because Alluxio didn't recognize...

@jasondrogba Thank you for your suggestions and patient answers. I will change to single tieredstore. If the same problem still occurs after modification, I will update it again.