spark icon indicating copy to clipboard operation
spark copied to clipboard

Published 20 hours ago • verified publisher icon apache

[SPARK-49899][PYTHON][SS] Support deleteIfExists for TransformWithStateInPandas

Open bogao007 opened this issue 4 months ago • 0 comments

What changes were proposed in this pull request?

  • Support deleteIfExists for TransformWithStateInPandas.
  • Added close() support for StatefulProcessor.

Why are the changes needed?

Add parity to TransformWithStateInPandas for functionalities we support in TransformWithState

Does this PR introduce any user-facing change?

Yes

How was this patch tested?

New unit test.

Was this patch authored or co-authored using generative AI tooling?

No

bogao007 avatar Oct 07 '24 18:10 bogao007