[Bug] [Task] Spark Task resources not exist

[a1281069907]

Search before asking

• [X] I had searched in the issues and found no similar issues.

What happened

After the spark jars(including main jar and config files) are submitted, spark task can not find the config file but the spark jar can be found...

What you expected to happen

spark task can find the config file, the task can finish well.

How to reproduce

if your spark task need a config file as a parameter, then the issue will be reproduced

Anything else

No response

Version

3.1.x

Are you willing to submit PR?

• [X] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct

[ruanwenjun]

@a1281069907 Can you find out these con files under the task instance working directory? I am not clear if this is caused by your code is incorrect, the conf file is not under classpath, please test you code locally.

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

[github-actions[bot]]

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.