DeepSpeedExamples
DeepSpeedExamples copied to clipboard
microsoft
Example models using DeepSpeed
Error occurred running megatron/Megatron-LM-v1.1.5-3D_parallelism/examples/ds_pretrain_gpt2_pipe.sh > finished creating GPT2 datasets ... setting training data start iteration to 0 setting validation data start iteration to 0 done with setups ... time (ms)...
In step3 for rlhf finetuning, there is an actor and a critic. The actor and critic may required different tokenizers. For example, the actor is opt-1.3B, while the critic is...
The `train.py` will search for `run_6.7b.sh` by default for 6.7B size, but no files are named `run_6.7b.sh` in step1 and step3. So I copied them from the existing `run_6.7b_lora.sh` and...
Bump future from 0.18.2 to 0.18.3 in /MoQ/huggingface-transformers/examples/research_projects/lxmert
Bumps [future](https://github.com/PythonCharmers/python-future) from 0.18.2 to 0.18.3. Release notes Sourced from future's releases. v0.18.3 This is a minor bug-fix release containing a number of fixes: Backport fix for bpo-38804 (c91d70b) Fix...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bump torch from 1.6.0 to 1.13.1 in /MoQ/huggingface-transformers/examples/research_projects/lxmert
Bumps [torch](https://github.com/pytorch/pytorch) from 1.6.0 to 1.13.1. Release notes Sourced from torch's releases. PyTorch 1.13.1 Release, small bug fix release This release is meant to fix the following issues (regressions /...
Bumps [jupyter-core](https://github.com/jupyter/jupyter_core) from 4.6.3 to 4.11.2. Release notes Sourced from jupyter-core's releases. 4.11.1 What's Changed Fix inclusion of jupyter file and check in CI by @blink1073 in jupyter/jupyter_core#276 Full Changelog:...
Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.0.2 to 3.1.30. Release notes Sourced from gitpython's releases. v3.1.30 - with important security fixes See gitpython-developers/GitPython#1515 for details. 3.1.20 No release notes provided. Commits 141cd65 adjust...
Bumps [certifi](https://github.com/certifi/python-certifi) from 2020.6.20 to 2022.12.7. Commits 9e9e840 2022.12.07 b81bdb2 2022.09.24 939a28f 2022.09.14 aca828a 2022.06.15.2 de0eae1 Only use importlib.resources's new files() / Traversable API on Python ≥3.11 ... b8eb5e9 2022.06.15.1...