incubator-gluten
incubator-gluten copied to clipboard
[CH] It's easy to occur OOM in window functions
Backend
CH (ClickHouse)
Bug description
[Expected behavior] and [actual behavior].
When the partition is too large, OOM is too easy to occur. For an example, row_number
doesn't need to keep all blocks in a frame in memory to generate result.
Spark version
None
Spark configurations
No response
System information
No response
Relevant logs
No response