incubator-uniffle icon indicating copy to clipboard operation
incubator-uniffle copied to clipboard

[Improvement] Use FileChannel to replace FileOutputStream and DataOutputStream in LocalFileWriter

Open rickyma opened this issue 1 year ago • 1 comments

Code of Conduct

Search before asking

  • [X] I have searched in the issues and found no similar issues.

What would you like to be improved?

FileChannel can provide better performance than traditional IO streams, as it can take advantage of the underlying operating system's native IO capabilities, such as memory-mapped files and direct buffer access.

How should we improve?

No response

Are you willing to submit PR?

  • [X] Yes I am willing to submit a PR!

rickyma avatar Apr 01 '24 16:04 rickyma

If you have any ideas on this, please let me know. Anyone will be welcome to pick this up.

rickyma avatar Apr 01 '24 16:04 rickyma

Close this because FileChannel will cause RSS(Resident Set Size) to grow unexpectedly.

rickyma avatar May 20 '24 15:05 rickyma