MithunR

`test_unsupported_fallback_substring_index` fails with a legitimate cause: ``` E pyspark.errors.exceptions.captured.NumberFormatException: For input string: "rdd_value_2" ``` The other tests all pass with ANSI mode disabled.

This is odd. I can't seem to repro this failure now.

I have double-checked my work. These tests don't fail. I'm closing this. We can reopen this if we see failures in the future.

Yep, I think I spoke too soon. Reopening.

The problem with `.endswith` is proving elusive. While this can be repro-ed in test, its occurrence is occasional from the REPL. For a brief while, it could be repro-ed simply...

Yep, this is still baffling. Here is the exception: ``` py4j.protocol.Py4JJavaError: An error occurred while calling o206.endsWith. : java.lang.NullPointerException: Cannot invoke "org.apache.spark.sql.Column.expr()" because "x$1" is null at org.apache.spark.sql.Column$.$anonfun$fn$2(Column.scala:77) at scala.collection.immutable.ArraySeq.map(ArraySeq.scala:75)...

As for the problem highlighted in `test_unsupported_fallback_substring_index`, I'm fairly certain this is a bug in code-gen in Spark 4.0. Here's the stack trace: ``` scala> sql("select SUBSTRING_INDEX('a', '_', num) from...

Ah, there it is. Sorry, yes. This is a dupe of #1387. On the bright side, we have 2 seeds for failure repro.

It is extremely annoying that neither of the failure seeds are reproducing the failure on my workstation. These were failing reliably late last night.

I thought I'd already closed #1387 as a dupe of this. Closed now. We'll carry on here. Thanks for picking this up, @ldematte. I'll assign this to you. > The...