kubeflow
[feature] Cache Key Customization
Feature Area
/area backend /area sdk
What feature would you like to see?
Setting custom cache key at the task level
What is the use case or pain point?
Currently, the cache key in KFP is generated internally, and users are unable to customize or set it. However, some users have expressed the need for more granular control over caching behavior by setting custom cache keys at the task level.
Is there a workaround currently?
N/A
KFP community meeting discussion for this feature
https://www.youtube.com/watch?v=I5iynMg_DNk
Proposal:
https://docs.google.com/document/d/1oNgYyFYondaVSFf9Pd3Q9uVzaqBr5wrOMHKgX9MMa78/edit?tab=t.0
Love this idea? Give it a 👍.
Hi @HumairAK @zzmao, I would like to work on this issue as my first contribution in the community.
Hey @HumairAK, thanks for assigning it to me. I usually work on weekend for the opensource project due to a full time job which I'm also pursuing. I'll raise the PR with all the changes by this coming weekend.
Hey as it's more than 4 weeks and no PR was raised @TheSwarnim are you still working on this issue ?
Hi @Garvit-77 a PR was raised for this change some time ago. So was not checking out this https://github.com/kubeflow/pipelines/pull/11466 Please let me know if pick this PR and update with the relevant changes raised by the reviewer
@zzmao @HumairAK Is this issue still being worked on, or can I take it up?
Hello @YaelOh , @izuku-sds @HumairAK @TheSwarnim ,
I am still working on it(had baby leaving for a while). The SDK part is done: https://github.com/kubeflow/pipelines/pull/11466
If anyone want to work on the backend part, feel free to take it.
