spark-rapids icon indicating copy to clipboard operation
spark-rapids copied to clipboard

Drop spark-3.1.x support for spark-rapids

Open NvTimLiu opened this issue 1 year ago • 3 comments

CI part for the issue: https://github.com/NVIDIA/spark-rapids/issues/10955

We'll drop spark-3.1.x support from branch-24.08, change the default spark version string to 3.2.0

This change needs to work together with the source code update for dropping spark-3.1.x support

Will keep monitoring CI jobs status after all the related changes get merged

NvTimLiu avatar Jun 11 '24 09:06 NvTimLiu

Draft the PR, because this change needs to work together with the source code update for dropping spark-3.1.x support

NvTimLiu avatar Jun 11 '24 09:06 NvTimLiu

build

NvTimLiu avatar Jul 03 '24 04:07 NvTimLiu

can you also help remove 31x https://github.com/NVIDIA/spark-rapids/blob/branch-24.08/pom.xml#L866 from the test list? thanks

pxLi avatar Jul 03 '24 05:07 pxLi

Drop this, replaced by https://github.com/NVIDIA/spark-rapids/pull/11159

NvTimLiu avatar Jul 09 '24 11:07 NvTimLiu