byzer-lang
byzer-lang copied to clipboard
Scope SQLConf of session.active
What changes were proposed in this pull request?
Set activeSession before each script execution. Because spark functions.expr
use SQLConf of activeSession.
Refer to SPARK-44206, all SparkSession dataset methods already covered by withActive, but functions
still only use SQLConf of active SparkSession.
How was this patch tested?
Refer to SPARK-44206
Are there and DOC need to update?
Unnecessary