[Bug] linkis-engineplugin-spark cannot kill task in scala

[Alexkun]

trafficstars

Search before asking

• [X] I searched the issues and found no similar issues.

Linkis Component

linkis-cg-engineConnplugin

What happened + What you expected to happen

When a scala task was canceled, the Spark EngineConn will kill the task on yarn by SparkContext, while the task in scala intp was left.

Relevent platform

CentOS 7

Reproduction script

1. Submit a scala task, the contents are as bellow: `import org.slf4j.LoggerFactory import org.apache.linkis.common.utils.Utils

val logger = LoggerFactory.getLogger(getClass)

var count = 0 while (count < 100) { logger.warn(s"count = ${count}") count = count + 1 Thread.sleep(5000) }`

2. When an EngineConn was set up, kill the task
3. The task state will change into Canceled. Open the log of the EngineConn, and you will find that the scala into is still running.

Anything else

No response

Are you willing to submit a PR?

• [ ] Yes I am willing to submit a PR!

[github-actions[bot]]

:blush: Welcome to the Apache Linkis (incubating) community!! We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context. We will be here shortly.

If you are interested in contributing to our website project, please let us know! You can check out our contributing guide on :point_right: How to Participate in Project Contribution.

WeChat Group:

Mailing Lists:

name	description	Subscribe	Unsubscribe	archive
[email protected]	community activity information	subscribe	unsubscribe	archive