composer
composer copied to clipboard
mosaicml
Supercharge Your Model Training
# What does this PR do? # What issue(s) does this change relate to? # Before submitting - [ ] Have you read the [contributor guidelines](https://github.com/mosaicml/composer/blob/dev/CONTRIBUTING.md)? - [ ] Is...
# What does this PR do? After FSDP-ing the model, the optimizer should only contain parameters that require gradients (non-frozen parameters). This change is nice for LORA # What issue(s)...
Updates the requirements on [pydantic](https://github.com/pydantic/pydantic) to permit the latest version. Release notes Sourced from pydantic's releases. v2.0 2023-06-30 What's Changed 📝 Don't recomend to use TypeError on validators by @Kludex...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [vit-pytorch](https://github.com/lucidrains/vit-pytorch) from 0.35.8 to 1.2.4. Commits 9e3fec2 fix mpp ce4bcd0 address lucidrains/vit-pytorch#266 ad4ca19 enforce latest einops e1b08c1 fix tests c59843d add a version of simple vit using flash attention...
# What does this PR do? Fixes sequence parallel error conditions and adds type float for microbatch_size in typehints
# Add `log_analytics` function to `MosaicMLLogger` This adds a `log_analytics` function to the `MosaicMLLogger`, which records these metrics about composer runs on the Mosaic platform: - `fsdp_config` - `sharding_strategy` -...
## Problem The PR #3115 has added some checks to the scheduler. More precisely, the `_raise_if_max_duration_exceeds_t_max` raise the error: ``` 't_max {t_max} must be greater than or equal to max_duration...
# What does this PR do? Proposes a technical implementation to `set_epoch` on either `DataLoader.sampler` or `DataLoader.batch_sampler` if it is defined. # What issue(s) does this change relate to? -...
# What does this PR do? OCI doesn't properly handle their exception `oci._vendor.requests.exceptions.ChunkedEncodingError`. This means that no retries happen following their default retry strategy. The issue is that they have...
# What does this PR do? # What issue(s) does this change relate to? # Before submitting - [ ] Have you read the [contributor guidelines](https://github.com/mosaicml/composer/blob/dev/CONTRIBUTING.md)? - [ ] Is...