MithunR
MithunR
It appears that [apache/spark#43368](https://github.com/apache/spark/pull/44368) has found its way into Databricks 14.3. This issue looks to be a problem there as well.
> I think most of it (all of it?) has been already been covered in https://github.com/rapidsai/cuvs/pull/1296 though... That is accurate; I've covered this for the most part in #1296. When...
Just a heads up here, tangentially related to CUDA 13: With CUDA 13, there might be [a re-ordering where of CUDA symbols are made available by `jextract`](https://github.com/rapidsai/cuvs/pull/1332#issuecomment-3332283401) in Java: `headers_h`...
Trying to tackle the biggish ones first. It looks like the majority of the problems here are with `spark.sql.ansi.enabled=true`. The tests are passing, with ANSI mode disabled: ``` =============== 1661...
All these tests pass when ANSI mode is disabled.
The following tests fail with a missing read metric: ``` Caused by: java.util.NoSuchElementException: key not found: bufferTime at scala.collection.immutable.Map$EmptyMap$.apply(Map.scala:243) at scala.collection.immutable.Map$EmptyMap$.apply(Map.scala:239) at com.nvidia.spark.rapids.GpuTextBasedPartitionReader.readToTable(GpuTextBasedPartitionReader.scala:466) ``` 1. `test_basic_csv_read` 2. `test_csv_read_small_floats` 3. `test_date_formats_round_trip`...
I've taken myself off as the assignee. Beyond the triage, I'm not sure I'll be working on this in the short term.
This one is particularly interesting. The failure indicates a missing GPU metric: ``` 2024-06-12 18:30:10,128 [Executor task launch worker for task 0.0 in stage 41.0 (TID 164)] ERROR org.apache.spark.executor.Executor -...
I've unassigned myself from this bug. This should be sorted out after the missing GPU metrics are addressed.
Two of these tests (`test_broadcast_hash_join_fix_fallback_by_inputfile`, and `test_broadcast_nested_join_fix_fallback_by_inputfile`) seem to be failing with the same missing `gpuDecodeTime` metric: ``` E Caused by: java.util.NoSuchElementException: key not found: gpuDecodeTime E at scala.collection.immutable.Map$EmptyMap$.apply(Map.scala:243) E...