[tools/setup/setup.sh] Nightly cleanup
Description
[tools/setup/setup.sh] Cleanup redundant and unnecessary nightly dependencies ; use --no-deps ; minor other cleanup / DRYness
Tests
CI and manual:
$ bash ./dependencies/scripts/docker_build_dependency_image.sh DEVICE='tpu' MODE='nightly'
$ bash ./dependencies/scripts/docker_build_dependency_image.sh DEVICE='tpu' MODE='stable'
Checklist
Before submitting this PR, please make sure (put X in square brackets):
- [x] I have performed a self-review of my code. For an optional AI review, add the
gemini-reviewlabel. - [x] I have necessary comments in my code, particularly in hard-to-understand areas.
- [x] I have run end-to-end tests tests and provided workload links above if applicable.
- [x] I have made or will make corresponding changes to the doc if needed, including adding new documentation pages to the relevant Table of Contents (toctree directive) as explained in our documentation.
Thanks Samuel. Could you please also run a training for both of the
MODEoptions being updated here? As well as with/without explicitly settingJAX_VERSION?
It would also be good to pip show that the versions are what you would expect for each build
Thanks Samuel. Could you please also run a training for both of the
MODEoptions being updated here? As well as with/without explicitly settingJAX_VERSION?It would also be good to
pip showthat the versions are what you would expect for each build
@SamuelMarks - Can you also test the setup when MODE and JAX_VERSION are specified?
Comments will be addressed as part of https://github.com/AI-Hypercomputer/maxtext/pull/2833. Closing this PR.