data-prep-kit icon indicating copy to clipboard operation
data-prep-kit copied to clipboard
verified publisher icon IBM

[Bug] Kubeflow pipeline logs secrets in the logs file

Open Param-S opened this issue 9 months ago • 2 comments

Search before asking

  • [x] I searched the issues and found no similar issues.

Component

KFP workflows

What happened + What you expected to happen

If we launch any transformer through KFP pipeline, the runs "execute ray job" logs contains the input secrets details. Can we mask or not print the input secrets/tokens in the log.

Reproduction script

Launch any transformer through KFP pipeline and check the "execute ray job" stage logs output.

Anything else

No response

OS

Other

Python

3.10

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Param-S avatar Mar 18 '25 17:03 Param-S

Based on the discussion with @touma-I , we are probably going to move the secrets from the arguments to environment variables.

roytman avatar Mar 19 '25 14:03 roytman

this seems to be duplication of https://github.com/data-prep-kit/data-prep-kit/issues/1100

revit13 avatar Mar 19 '25 14:03 revit13

completed in version 1.1.2

swith005 avatar Jul 21 '25 18:07 swith005