add framingham-cvd-risk example
@lampajr and myself would like to propose this example. We hope this is interesting and useful! 👍 🚀
The goal and objectives of this example is listed in the README.md, included.
We have tested this using Kubeflow Pipelines 2.0.5 and KFP sdk 2.6.0.
Notes:
While building this example, we have noticed some limitations in the KF Pipelines/SDK as we were trying to make use of some of the KFP 2.x capabilities; we have found alternative ways and opted for those alternative in this example as it currently stand, but we believe these information could be helpful for the community, maybe could also be of support in prioritizing backlogs, etc. Sharing our notes below:
In a tightened Enterprise environment, container don't run as root. We used alternative image for components. See also:
- https://github.com/kubeflow/pipelines/issues/7345
We couldn't use Artifacts due to permission errors. See also:
- https://github.com/kubeflow/pipelines/issues/10397
We couldn't use ParallelFor as mountPVC not supported. See also:
- https://github.com/kubeflow/pipelines/issues/10243
We coudln't use Collected for the downstream tasks due to error:
{"error":"Failed to create a new run: InternalServerError: Failed to validate workflow for (): templates.entrypoint.tasks.root templates.root sorting failed: invalid dependency for-loop-2","code":13,"message":"Failed to create a new run: InternalServerError: Failed to validate workflow for (): templates.entrypoint.tasks.root templates.root sorting failed: invalid dependency for-loop-2","details":[{"@type":"type.googleapis.com/google.rpc.Status","code":13,"message":"Internal Server Error"}]}
We had to force disable caching on each task due to permission errors. See also:
- https://github.com/kubeflow/pipelines/issues/10188
Check out this pull request on ![]()
See visual diffs & provide feedback on Jupyter Notebooks.
Powered by ReviewNB
[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: tarilabs Once this PR has been reviewed and has the lgtm label, please assign js-ts for approval. For more information see the Kubernetes Code Review Process.
The full list of commands accepted by this bot can be found here.
Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment