spark-rapids icon indicating copy to clipboard operation
spark-rapids copied to clipboard

Add `Nan` handling in `GpuArrayMin`

Open HaoYang670 opened this issue 3 years ago • 1 comments

Signed-off-by: remzi [email protected]

Close #6317 Close #6330 Close #6332

Changes in this PR

  1. remove the hasNan configuration on GpuArrayMin
  2. Add Nan handling in GpuArrayMin
  • Just as GpuMax and GpuArrayMax, we create GpuBasicArrayMin and GpuFloatArrayMIn
  • The method to handle Nans is:
    • If a list only contains Nans or null, then we return Nan if the list contains Nan, otherwise return null Else, we replace all Nans to null and then call cuDF kernel to get the min value
  1. Update docs and tests

HaoYang670 avatar Aug 17 '22 07:08 HaoYang670

build

HaoYang670 avatar Aug 17 '22 08:08 HaoYang670

build

HaoYang670 avatar Aug 18 '22 03:08 HaoYang670

build

HaoYang670 avatar Aug 19 '22 02:08 HaoYang670

build

HaoYang670 avatar Aug 19 '22 05:08 HaoYang670