PySyft icon indicating copy to clipboard operation
PySyft copied to clipboard

[WIP] - Adding k8s testing for Bigquery

Open snwagh opened this issue 1 year ago • 1 comments

Working to close https://github.com/OpenMined/Heartbeat/issues/1770

TODO

  • Need to add a different k8s notebook that will run custom container (refer to the similar notebook in api/0.8)
    • This might not be necessary. The solution might be to get the permissions to pull the docker image from us-central1-docker.pkg.dev/reddit-testing-415005/syft-registry-us/openmined/bigquery:0.9.1-beta.6
  • Test locally using tox -e dev.k8s.start; tox -e dev.k8s.hotreload and running the notebooks
  • Add tox task called syft.test.notebook.scenario.k8s (though more similar to syft.test.helm or stack.test.notebook.k8s )
    • Remove k8s notebook 1 from tox task syft.test.notebook.scenario
    • Remove in memory python notebook 1 from tox task syft.test.notebook.scenario.k8s
  • Add the new tox to cd-post-release-tests.yml and pr-tests-stack.yml
    • Nightlies and pre release CI/CD get it from nightlies.yml and cd-syft.yml resp.

snwagh avatar Aug 26 '24 16:08 snwagh

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB