linkis icon indicating copy to clipboard operation
linkis copied to clipboard

[Bug] [linkis-orchestrator] If I failed to launch a engine, my next same type engine will reuse properties of the last failed one.

Open Alexkun opened this issue 3 years ago • 1 comments

Search before asking

  • [X] I searched the issues and found no similar issues.

Linkis Component

linkis-orchestrator

Steps to reproduce

  1. set 'spark.driver.memory=500g' in IDE,spark-2.4.3.
  2. submit a spark task, and it will fail to start an engine.
  3. set 'spark.driver.memory=2g' in IDE,spark-2.4.3.
  4. submit a spark task, and it will fail to start an engine because it still has the properties: 'spark.driver.memory=500g'

Expected behavior

if I changed the config, it should use the latest config on starting engines.

Your environment

  • Linkis version used: 1.2.0
  • Environment name and version:
  • spark-2.4.3
    • ....

Anything else

No response

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Alexkun avatar Sep 15 '22 14:09 Alexkun

:blush: Welcome to the Apache Linkis (incubating) community!!

We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context. We will be here shortly.

If you are interested in contributing to our website project, please let us know! You can check out our contributing guide on :point_right: How to Participate in Project Contribution.

Community

WeChat Assistant WeChat Public Account

Mailing Lists

name description Subscribe Unsubscribe archive
[email protected] community activity information subscribe unsubscribe archive

github-actions[bot] avatar Sep 15 '22 15:09 github-actions[bot]