Kosteev Eugene
Kosteev Eugene
@bobhancock @BenRKarl I would like to point your attention to this issue as it is severe enough for Cloud Composer team right now.
Thank you very much!
hey! How is it going? This actually doesn't work in my case because context is initialized before with `SparkSession` class and `SparklySession` tries to initialize it again (`SparklySession._instantiated_session == None`)....
Hey @mantzouratos! I would like to have it for production. It would be great, if `SparklySession` is able to receive `spark_context` as an optional parameter in constructor. And if it...
@drudim works for me!
Hi Karthikeyan. That looks good. Do you mind to prepare PR with the changes?
I didn't test it in Airflow 2.9, but the implementation of the DAG processor at this place of code should be the same, so the issue has to be there...