pipelines icon indicating copy to clipboard operation
pipelines copied to clipboard

chore: bump requests-toolbelt to 1.0.0 fixes #10470

Open SimonDR-Boltzmann opened this issue 1 year ago • 28 comments

Description of your changes:

Bumps requests-toolbelt from 0.9.1 to 1.0.0 (see #10470)

Checklist:

SimonDR-Boltzmann avatar Apr 29 '24 12:04 SimonDR-Boltzmann

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: Once this PR has been reviewed and has the lgtm label, please assign zijianjoy for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

google-oss-prow[bot] avatar Apr 29 '24 12:04 google-oss-prow[bot]

Hi @SimonDR-Boltzmann. Thanks for your PR.

I'm waiting for a kubeflow member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

google-oss-prow[bot] avatar Apr 29 '24 12:04 google-oss-prow[bot]

/ok-to-test

rimolive avatar Apr 29 '24 13:04 rimolive

@SimonDR-Boltzmann I believe this is not the only place to upgrade requests-toolbelt. Looking at the entire repo, I see at least 8 other occurrences of that Python package. I'm new to the kfp code, so I'm unsure what the root requirements.txt does in the code, but I can tell you that the ones inside backend/ and sdk/python are the most important ones. And there's the test/kfp-functional-test/requirements.txt file to run the functional tests with that new dependency version.

That being said, ensure that all occurrences of that package are upgraded to 1.1.0 version.

rimolive avatar Apr 29 '24 14:04 rimolive

@SimonDR-Boltzmann I believe this is not the only place to upgrade requests-toolbelt. Looking at the entire repo, I see at least 8 other occurrences of that Python package. I'm new to the kfp code, so I'm unsure what the root requirements.txt does in the code, but I can tell you that the ones inside backend/ and sdk/python are the most important ones. And there's the test/kfp-functional-test/requirements.txt file to run the functional tests with that new dependency version.

That being said, ensure that all occurrences of that package are upgraded to 1.1.0 version.

@rimolive You're right, I should have checked. It also seems the 1.1.0 is not on pypi yet, so I've bumped to 1.0.0 instead

SimonDR-Boltzmann avatar Apr 29 '24 14:04 SimonDR-Boltzmann

/test kubeflow-pipeline-e2e-test

rimolive avatar Apr 30 '24 23:04 rimolive

@SimonDR-Boltzmann: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
kubeflow-pipeline-upgrade-test 0514d220c03108424ca3eef04c0c2f314deea434 link true /test kubeflow-pipeline-upgrade-test
kfp-kubernetes-execution-tests 0514d220c03108424ca3eef04c0c2f314deea434 link false /test kfp-kubernetes-execution-tests
kubeflow-pipelines-sdk-execution-tests 0514d220c03108424ca3eef04c0c2f314deea434 link true /test kubeflow-pipelines-sdk-execution-tests
kubeflow-pipeline-e2e-test 0514d220c03108424ca3eef04c0c2f314deea434 link true /test kubeflow-pipeline-e2e-test

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

google-oss-prow[bot] avatar Apr 30 '24 23:04 google-oss-prow[bot]

@rimolive I could use your help debugging these failed tests, I'm not sure what the CancelledErrors mean, and I get a 403 when I click on the experiment/run details links.

SimonDR-Boltzmann avatar May 07 '24 07:05 SimonDR-Boltzmann

@SimonDR-Boltzmann Just rebase and I believe the new Github Action tests will run.

rimolive avatar Jun 17 '24 15:06 rimolive

@SimonDR-Boltzmann: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
kubeflow-pipeline-upgrade-test 3d7827e7a8dae928c1d7a135cc3c891c7167ac74 link false /test kubeflow-pipeline-upgrade-test
kubeflow-pipeline-e2e-test 3d7827e7a8dae928c1d7a135cc3c891c7167ac74 link false /test kubeflow-pipeline-e2e-test
kfp-kubernetes-execution-tests 3d7827e7a8dae928c1d7a135cc3c891c7167ac74 link false /test kfp-kubernetes-execution-tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

google-oss-prow[bot] avatar Jun 17 '24 16:06 google-oss-prow[bot]

@SimonDR-Boltzmann Just rebase and I believe the new Github Action tests will run.

@rimolive It seems the tests still fail, but I still can't seem to access the relevant logs to see what's going on.

SimonDR-Boltzmann avatar Jun 18 '24 07:06 SimonDR-Boltzmann

@SimonDR-Boltzmann you can ignore those tests. They are all optional. We can see it here.

hbelmiro avatar Jun 18 '24 11:06 hbelmiro

@SimonDR-Boltzmann please rebase this PR. We've done some test fixes, and maybe everything will just pass now.

gregsheremeta avatar Aug 19 '24 12:08 gregsheremeta

@SimonDR-Boltzmann May I ask to rebase again? We migrated most of these tests to GitHub actions, now we can run propoer tests in your PR

rimolive avatar Aug 19 '24 12:08 rimolive

/rerun-all

rimolive avatar Aug 19 '24 12:08 rimolive

Looks much better now, but the problem seems to be that in backend/requirements.txt both kfp and requests-toolbelt are dependencies. I'm not sure how synchronous those requirements.txt files should be, but I'll try reverting the update in that file only. Let me know whether that makes sense or not.

SimonDR-Boltzmann avatar Aug 19 '24 15:08 SimonDR-Boltzmann

/rerun-all

rimolive avatar Aug 19 '24 17:08 rimolive

/lgtm

cc @HumairAK @gregsheremeta @chensun @zijianjoy

rimolive avatar Aug 19 '24 19:08 rimolive

I don't have experience updating python dependencies yet, but this looks solid to me, and the tests pass.

thanks!

/lgtm

gregsheremeta avatar Aug 19 '24 21:08 gregsheremeta

@chensun @zijianjoy could you please review this? thank you in advance

SimonDR-Boltzmann avatar Sep 10 '24 07:09 SimonDR-Boltzmann

New changes are detected. LGTM label has been removed.

google-oss-prow[bot] avatar Sep 12 '24 09:09 google-oss-prow[bot]

/rerun-all

rimolive avatar Sep 12 '24 22:09 rimolive

@SimonDR-Boltzmann There are some failling tests. Can you take a look?

rimolive avatar Sep 13 '24 12:09 rimolive

@SimonDR-Boltzmann There are some failling tests. Can you take a look?

@rimolive Apart from the

E       AssertionError: Pipeline components-preprocess ended with incorrect status: FAILED. More info: http://localhost:8888/#/runs/details/c86fcaeb-9963-4272-b6e1-817d8429d381
E       assert 'FAILED' == 'SUCCEEDED'
E         - SUCCEEDED
E         + FAILED

I can't really tell what's the cause of the errors. I'm having some trouble testing locally, could you point me in the right direction?

SimonDR-Boltzmann avatar Sep 17 '24 07:09 SimonDR-Boltzmann

I tried to run the tests locally as well (to see if I could help you out) and building images fails for me:

sha256:f326c34ea3fa9c3e2a71ffb6f85986c988a4d0bdc270b28fe3642502426fc125
The push refers to repository [kind-registry:5000/apiserver]
Get "https://kind-registry:5000/v2/": dial tcp: lookup kind-registry: no such host
Failed to build apiserver image.

I might be doing something wrong. It's my first time trying to do this.

Anyone know if we have documentation somewhere for running these e2e kind tests locally?

gregsheremeta avatar Sep 19 '24 11:09 gregsheremeta

/hold

diegolovison avatar Sep 19 '24 12:09 diegolovison

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: Once this PR has been reviewed and has the lgtm label, please assign connor-mccarthy for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

google-oss-prow[bot] avatar Sep 19 '24 15:09 google-oss-prow[bot]

/rerun-all

hbelmiro avatar Sep 19 '24 15:09 hbelmiro

Hello! Can this be merged?

smthngslv avatar Oct 13 '24 10:10 smthngslv

No. We need to fix https://github.com/kubeflow/pipelines/pull/10762#discussion_r1770597904

diegolovison avatar Oct 14 '24 12:10 diegolovison