examples icon indicating copy to clipboard operation
examples copied to clipboard

add framingham-cvd-risk example

Open tarilabs opened this issue 2 years ago • 2 comments

@lampajr and myself would like to propose this example. We hope this is interesting and useful! 👍 🚀

The goal and objectives of this example is listed in the README.md, included.

We have tested this using Kubeflow Pipelines 2.0.5 and KFP sdk 2.6.0.

Notes:

While building this example, we have noticed some limitations in the KF Pipelines/SDK as we were trying to make use of some of the KFP 2.x capabilities; we have found alternative ways and opted for those alternative in this example as it currently stand, but we believe these information could be helpful for the community, maybe could also be of support in prioritizing backlogs, etc. Sharing our notes below:

In a tightened Enterprise environment, container don't run as root. We used alternative image for components. See also:

  • https://github.com/kubeflow/pipelines/issues/7345

We couldn't use Artifacts due to permission errors. See also:

  • https://github.com/kubeflow/pipelines/issues/10397

We couldn't use ParallelFor as mountPVC not supported. See also:

  • https://github.com/kubeflow/pipelines/issues/10243

We coudln't use Collected for the downstream tasks due to error:

{"error":"Failed to create a new run: InternalServerError: Failed to validate workflow for (): templates.entrypoint.tasks.root templates.root sorting failed: invalid dependency for-loop-2","code":13,"message":"Failed to create a new run: InternalServerError: Failed to validate workflow for (): templates.entrypoint.tasks.root templates.root sorting failed: invalid dependency for-loop-2","details":[{"@type":"type.googleapis.com/google.rpc.Status","code":13,"message":"Internal Server Error"}]}

We had to force disable caching on each task due to permission errors. See also:

  • https://github.com/kubeflow/pipelines/issues/10188

tarilabs avatar Jan 22 '24 12:01 tarilabs

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: tarilabs Once this PR has been reviewed and has the lgtm label, please assign js-ts for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

google-oss-prow[bot] avatar Jan 22 '24 12:01 google-oss-prow[bot]