fengsen comments

Repositories
Issues
Comments

Results 2 comments of


                                            fengsen

When we use spark action rewriteDataFiles, how to limit equality_delete file compations memory.

> A large amount of memory is used because each datafile will read all the data of the deletefile which seqNum is bigger than datafile in a hashSet for filtering,...

When we use spark action rewriteDataFiles, how to limit equality_delete file compations memory.

> A large amount of memory is used because each datafile will read all the data of the deletefile which seqNum is bigger than datafile in a hashSet for filtering,...