codeflare-sdk
codeflare-sdk copied to clipboard
Bump the requirements-txt group across 2 directories with 3 updates
Bumps the requirements-txt group with 3 updates in the /demo-notebooks/guided-demos directory: pytorch-lightning, torchmetrics and torchvision. Bumps the requirements-txt group with 3 updates in the /tests/e2e directory: pytorch-lightning, torchmetrics and torchvision.
Updates pytorch-lightning from 1.9.5 to 2.4.0
Release notes
Sourced from pytorch-lightning's releases.
Lightning v2.4
Lightning AI :zap: is excited to announce the release of Lightning 2.4. This is mainly a compatibility upgrade for PyTorch 2.4 and Python 3.12, with a sprinkle of a few features and bug fixes.
Did you know? The Lightning philosophy extends beyond a boilerplate-free deep learning framework: We've been hard at work bringing you Lightning Studio. Code together, prototype, train, deploy, host AI web apps. All from your browser, with zero setup.
Changes
PyTorch Lightning
- Made saving non-distributed checkpoints fully atomic (#20011)
- Added
dump_statsflag toAdvancedProfiler(#19703)- Added a flag
verboseto theseed_everything()function (#20108)- Added support for PyTorch 2.4 (#20010)
- Added support for Python 3.12 (20078)
- The
TQDMProgressBarnow provides an option to retain prior training epoch bars (#19578)- Added the count of modules in train and eval mode to the printed
ModelSummarytable (#20159)
- Triggering KeyboardInterrupt (Ctrl+C) during
.fit(),.evaluate(),.test()or.predict()now terminates all processes launched by the Trainer and exits the program (#19976)- Changed the implementation of how seeds are chosen for dataloader workers when using
seed_everything(..., workers=True)(#20055)- NumPy is no longer a required dependency (#20090)
- Avoid LightningCLI saving hyperparameters with
class_pathandinit_argssince this would be a breaking change (#20068)- Fixed an issue that would cause too many printouts of the seed info when using
seed_everything()(#20108)- Fixed
_LoggerConnector's_ResultMetricto move all registered keys to the device of the logged value if needed (#19814)- Fixed
_optimizer_to_devicelogic for special 'step' key in optimizer state causing performance regression (#20019)- Fixed parameter counts in
ModelSummarywhen model has distributed parameters (DTensor) (#20163)Lightning Fabric
... (truncated)
Commits
2129fdffix(ci): resolve input str -> num conversion (#20169)cf24a19fix(docs): remove dead link from readme (#20170)a3e60adci/docs: disable optional cache pkg (#20168)87ffd8cci: fix cleaning caches (#20167)b3ee85dPrepare Lightning 2.4.0 release (#20154)631911cAdd special logic for 'step' in _optimizer_to_device (#20019)345450bFix parameter count in ModelSummary when parameters are DTensors (#20163)3de60f4docs: fix typo inlinkcheck_ignore(#20164)e9d4ef8Add diffusion example to README (#20161)d4de8e2Count number of modules in train/eval mode in ModelSummary (#20159)- Additional commits viewable in compare view
Updates torchmetrics from 0.9.1 to 1.4.1
Release notes
Sourced from torchmetrics's releases.
Minor patch release
[1.4.1] - 2024-08-02
Changed
- Calculate the text color of
ConfusionMatrixplot based on luminance (#2590)- Updated
_safe_divideto allowAccuracyto run on the GPU (#2640)- Improved better error messages for intersection detection metrics for wrong user input (#2577)
Removed
- Dropped
Chrfimplementation due to licensing issues with the upstream package (#2668)Fixed
- Fixed bug in
MetricCollectionwhen using compute groups andcomputeis called more than once (#2571)- Fixed class order of
panoptic_quality(..., return_per_class=True)output (#2548)- Fixed
BootstrapWrappernot being reset correctly (#2574)- Fixed integration between
ClasswiseWrapperandMetricCollectionwith custom_filter_kwargsmethod (#2575)- Fixed BertScore calculation: pred target misalignment (#2347)
- Fixed
_cumsumhelper function in multi-gpu (#2636)- Fixed bug in
MeanAveragePrecision.coco_to_tm(#2588)- Fixed missed f-strings in exceptions/warnings (#2667)
Key Contributors
@Borda,@gxy-gxy,@i-aki-y,@ndrwrbgs,@relativityhd,@SkafteNickiIf we forgot someone due to not matching commit email with GitHub account, let us know :]
Full Changelog: https://github.com/Lightning-AI/torchmetrics/compare/v1.4.0...v1.4.1
Minor dependency correction
Full Changelog: https://github.com/Lightning-AI/torchmetrics/compare/v1.4.0...v1.4.0.post0
Metrics for segmentation
In Torchmetrics v1.4, we are happy to introduce a new domain of metrics to the library: segmentation metrics. Segmentation metrics are used to evaluate how well segmentation algorithms are performing, e.g., algorithms that take in an image and pixel-by-pixel decide what kind of object it is. These kind of algorithms are necessary in applications such as self driven cars. Segmentations are closely related to classification metrics, but for now, in Torchmetrics, expect the input to be formatted differently; see the documentation for more info. For now,
MeanIoUandGeneralizedDiceScorehave been added to the subpackage, with many more to follow in upcoming releases of Torchmetrics. We are happy to receive any feedback on metrics to add in the future or the user interface for the new segmentation metrics.Torchmetrics v1.3 adds new metrics to the classification and image subpackage and has multiple bug fixes and other quality-of-life improvements. We refer to the changelog for the complete list of changes.
[1.4.0] - 2024-05-03
Added
... (truncated)
Changelog
Sourced from torchmetrics's changelog.
[1.4.1] - 2024-08-02
Changed
- Calculate text color of
ConfusionMatrixplot based on luminance (#2590)- Updated
_safe_divideto allowAccuracyto run on the GPU (#2640)- Improved error messages for intersection detection metrics for wrong user input (#2577)
Removed
- Dropped
Chrfimplementation due to licensing issues with the upstream package (#2668)Fixed
- Fixed bug in
MetricCollectionwhen using compute groups andcomputeis called more than once (#2571)- Fixed class order of
panoptic_quality(..., return_per_class=True)output (#2548)- Fixed
BootstrapWrappernot being reset correctly (#2574)- Fixed integration between
ClasswiseWrapperandMetricCollectionwith custom_filter_kwargsmethod (#2575)- Fixed BertScore calculation: pred target misalignment (#2347)
- Fixed
_cumsumhelper function in multi-gpu (#2636)- Fixed bug in
MeanAveragePrecision.coco_to_tm(#2588)- Fixed missed f-strings in exceptions/warnings (#2667)
[1.4.0] - 2024-05-03
Added
- Added
SensitivityAtSpecificitymetric to classification subpackage (#2217)- Added
QualityWithNoReferencemetric to image subpackage (#2288)- Added a new segmentation metric:
- Added support for calculating segmentation quality and recognition quality in
PanopticQualitymetric (#2381)- Added
pretty-errorsfor improving error prints (#2431)- Added support for
torch.floatweighted networks for FID and KID calculations (#2483)- Added
zero_divisionargument to selected classification metrics (#2198)Changed
- Made
__getattr__and__setattr__ofClasswiseWrappermore general (#2424)Fixed
- Fix getitem for metric collection when prefix/postfix is set (#2430)
- Fixed axis names with Precision-Recall curve (#2462)
- Fixed list synchronization with partly empty lists (#2468)
- Fixed memory leak in metrics using list states (#2492)
- Fixed bug in computation of
ERGASmetric (#2498)- Fixed
BootStrapperwrapper not working withkwargsprovided argument (#2503)
... (truncated)
Commits
59d67efreleasing1.4.11309b07test: update after ChrF removedd95c772build(deps): update huggingface-hub requirement from <0.24 to <0.25 in /requi...683b620text: temp dropChrfimplementation (#2668)83ff38dbuild(deps): update scipy requirement from <1.14.0,>1.0.0 to >1.0.0,<1.15.0 i...72e8304build(deps): bump Lightning-AI/utilities from 0.11.3.post0 to 0.11.6 (#2666)7a66579fix missed f-strings (#2667)98c5456docs: fix broken link32279a6Update_safe_divideto allowAccuracyto run on the GPU (#2640)d214dbebuild(deps): bump lightning-utilities from 0.11.3.post0 to 0.11.5 in /require...- Additional commits viewable in compare view
Updates torchvision from 0.12.0 to 0.19.0
Release notes
Sourced from torchvision's releases.
Torchvision 0.19 release
Highlights
Encoding / Decoding images
Torchvision is extending its encoding/decoding capabilities. For this version, we added a GIF decoder which is available as
torchvision.io.decode_gif(raw_tensor),torchvision.io.decode_image(raw_tensor), andtorchvision.io.read_image(path_to_image).We also added support for jpeg GPU encoding in
torchvision.io.encode_jpeg(). This is 10X faster than the existing CPU jpeg encoder.Stay tuned for more improvements coming in the next versions. We plan to improve jpeg GPU decoding, and add more image decoders (webp in particular).
Resizing according to the longest edge of an image
It is now possible to resize images by setting
torchvision.transforms.v2.Resize(max_size=N): this will resize the longest edge of the image exactly tomax_size, making sure the image dimension don't exceed this value. Read more on the docs!Detailed changes
Bug Fixes
[datasets]
SBDataset: Only download noval file when image_set='train_noval' (#8475) [datasets] Update the download url in classEMNIST(#8350) [io] Fix compilation error when there is nolibjpeg(#8342) [reference scripts] Fix use ofcutmix_alphain classification training references (#8448) [utils] AllowK=1indraw_keypoints(#8439)New Features
[io] Add decoder for GIF images (
decode_gif(),decode_image(),read_image()) (#8406, #8419) [transforms] AddGaussianNoisetransform (#8381)Improvements
[transforms] Allow v2
Resizeto resize longer edge exactly tomax_size(#8459) [transforms] Addmin_areaparameter toSanitizeBoundingBox(#7735) [transforms] Makeadjust_hue()work withnumpy 2.0(#8463) [transforms] Enable one-hot-encoded labels inMixUpandCutMix(#8427) [transforms] Create kernel on-device fortransforms.functional.gaussian_blur(#8426) [io] Adding GPU acceleration toencode_jpeg(10X faster than CPU encoder) (#8391) [io]read_video: acceptBytesIOobjects onpyavbackend (#8442) [io] Add compatibility with FFMPEG 7.0 (#8408) [datasets] Add extra to installgdown(#8430) [datasets] Support encodedRLEformat in forCOCOsegmentations (#8387) [datasets] Added binary cat vs dog classification target type to Oxford pet dataset (#8388) [datasets] Return labels forFER2013if possible (#8452) [ops] Force use oftorch.compileon deterministicroi_alignimplementation (#8436) [utils] add float support toutils.draw_bounding_boxes()(#8328)
... (truncated)
Commits
48b1edfRemove prototype area for 0.19 (#8491)f44f20cUse@release/2.4 instead of@mainfor CI jobs (#8490)143d078Adding GPU acceleration to encode_jpeg (#8391)f96c42fRe-enable vision MPS builds (#8485)f1bcbd3[FBcode->GH] Fix using namespace in pytorch/vision/torchvision/csrc/io/video/...27764a1Skip flaky earth gif test on OSS CI (#8480)b09b3f6Remove unused dynamo import (#8451)375cfdfAdd compatibility with FFMPEG 7.0 (#8408)a839642Load _C ops before registering meta implementations (#8470)bcf6cdaSBDataset: Only download noval file when image_set='train_noval' (#8475)- Additional commits viewable in compare view
Updates pytorch-lightning from 1.9.5 to 2.4.0
Release notes
Sourced from pytorch-lightning's releases.
Lightning v2.4
Lightning AI :zap: is excited to announce the release of Lightning 2.4. This is mainly a compatibility upgrade for PyTorch 2.4 and Python 3.12, with a sprinkle of a few features and bug fixes.
Did you know? The Lightning philosophy extends beyond a boilerplate-free deep learning framework: We've been hard at work bringing you Lightning Studio. Code together, prototype, train, deploy, host AI web apps. All from your browser, with zero setup.
Changes
PyTorch Lightning
- Made saving non-distributed checkpoints fully atomic (#20011)
- Added
dump_statsflag toAdvancedProfiler(#19703)- Added a flag
verboseto theseed_everything()function (#20108)- Added support for PyTorch 2.4 (#20010)
- Added support for Python 3.12 (20078)
- The
TQDMProgressBarnow provides an option to retain prior training epoch bars (#19578)- Added the count of modules in train and eval mode to the printed
ModelSummarytable (#20159)
- Triggering KeyboardInterrupt (Ctrl+C) during
.fit(),.evaluate(),.test()or.predict()now terminates all processes launched by the Trainer and exits the program (#19976)- Changed the implementation of how seeds are chosen for dataloader workers when using
seed_everything(..., workers=True)(#20055)- NumPy is no longer a required dependency (#20090)
- Avoid LightningCLI saving hyperparameters with
class_pathandinit_argssince this would be a breaking change (#20068)- Fixed an issue that would cause too many printouts of the seed info when using
seed_everything()(#20108)- Fixed
_LoggerConnector's_ResultMetricto move all registered keys to the device of the logged value if needed (#19814)- Fixed
_optimizer_to_devicelogic for special 'step' key in optimizer state causing performance regression (#20019)- Fixed parameter counts in
ModelSummarywhen model has distributed parameters (DTensor) (#20163)Lightning Fabric
... (truncated)
Commits
2129fdffix(ci): resolve input str -> num conversion (#20169)cf24a19fix(docs): remove dead link from readme (#20170)a3e60adci/docs: disable optional cache pkg (#20168)87ffd8cci: fix cleaning caches (#20167)b3ee85dPrepare Lightning 2.4.0 release (#20154)631911cAdd special logic for 'step' in _optimizer_to_device (#20019)345450bFix parameter count in ModelSummary when parameters are DTensors (#20163)3de60f4docs: fix typo inlinkcheck_ignore(#20164)e9d4ef8Add diffusion example to README (#20161)d4de8e2Count number of modules in train/eval mode in ModelSummary (#20159)- Additional commits viewable in compare view
Updates torchmetrics from 0.9.1 to 1.4.1
Release notes
Sourced from torchmetrics's releases.
Minor patch release
[1.4.1] - 2024-08-02
Changed
- Calculate the text color of
ConfusionMatrixplot based on luminance (#2590)- Updated
_safe_divideto allowAccuracyto run on the GPU (#2640)- Improved better error messages for intersection detection metrics for wrong user input (#2577)
Removed
- Dropped
Chrfimplementation due to licensing issues with the upstream package (#2668)Fixed
- Fixed bug in
MetricCollectionwhen using compute groups andcomputeis called more than once (#2571)- Fixed class order of
panoptic_quality(..., return_per_class=True)output (#2548)- Fixed
BootstrapWrappernot being reset correctly (#2574)- Fixed integration between
ClasswiseWrapperandMetricCollectionwith custom_filter_kwargsmethod (#2575)- Fixed BertScore calculation: pred target misalignment (#2347)
- Fixed
_cumsumhelper function in multi-gpu (#2636)- Fixed bug in
MeanAveragePrecision.coco_to_tm(#2588)- Fixed missed f-strings in exceptions/warnings (#2667)
Key Contributors
@Borda,@gxy-gxy,@i-aki-y,@ndrwrbgs,@relativityhd,@SkafteNickiIf we forgot someone due to not matching commit email with GitHub account, let us know :]
Full Changelog: https://github.com/Lightning-AI/torchmetrics/compare/v1.4.0...v1.4.1
Minor dependency correction
Full Changelog: https://github.com/Lightning-AI/torchmetrics/compare/v1.4.0...v1.4.0.post0
Metrics for segmentation
In Torchmetrics v1.4, we are happy to introduce a new domain of metrics to the library: segmentation metrics. Segmentation metrics are used to evaluate how well segmentation algorithms are performing, e.g., algorithms that take in an image and pixel-by-pixel decide what kind of object it is. These kind of algorithms are necessary in applications such as self driven cars. Segmentations are closely related to classification metrics, but for now, in Torchmetrics, expect the input to be formatted differently; see the documentation for more info. For now,
MeanIoUandGeneralizedDiceScorehave been added to the subpackage, with many more to follow in upcoming releases of Torchmetrics. We are happy to receive any feedback on metrics to add in the future or the user interface for the new segmentation metrics.Torchmetrics v1.3 adds new metrics to the classification and image subpackage and has multiple bug fixes and other quality-of-life improvements. We refer to the changelog for the complete list of changes.
[1.4.0] - 2024-05-03
Added
... (truncated)
Changelog
Sourced from torchmetrics's changelog.
[1.4.1] - 2024-08-02
Changed
- Calculate text color of
ConfusionMatrixplot based on luminance (#2590)- Updated
_safe_divideto allowAccuracyto run on the GPU (#2640)- Improved error messages for intersection detection metrics for wrong user input (#2577)
Removed
- Dropped
Chrfimplementation due to licensing issues with the upstream package (#2668)Fixed
- Fixed bug in
MetricCollectionwhen using compute groups andcomputeis called more than once (#2571)- Fixed class order of
panoptic_quality(..., return_per_class=True)output (#2548)- Fixed
BootstrapWrappernot being reset correctly (#2574)- Fixed integration between
ClasswiseWrapperandMetricCollectionwith custom_filter_kwargsmethod (#2575)- Fixed BertScore calculation: pred target misalignment (#2347)
- Fixed
_cumsumhelper function in multi-gpu (#2636)- Fixed bug in
MeanAveragePrecision.coco_to_tm(#2588)- Fixed missed f-strings in exceptions/warnings (#2667)
[1.4.0] - 2024-05-03
Added
- Added
SensitivityAtSpecificitymetric to classification subpackage (#2217)- Added
QualityWithNoReferencemetric to image subpackage (#2288)- Added a new segmentation metric:
- Added support for calculating segmentation quality and recognition quality in
PanopticQualitymetric (#2381)- Added
pretty-errorsfor improving error prints (#2431)- Added support for
torch.floatweighted networks for FID and KID calculations (#2483)- Added
zero_divisionargument to selected classification metrics (#2198)Changed
- Made
__getattr__and__setattr__ofClasswiseWrappermore general (#2424)Fixed
- Fix getitem for metric collection when prefix/postfix is set (#2430)
- Fixed axis names with Precision-Recall curve (#2462)
- Fixed list synchronization with partly empty lists (#2468)
- Fixed memory leak in metrics using list states (#2492)
- Fixed bug in computation of
ERGASmetric (#2498)- Fixed
BootStrapperwrapper not working withkwargsprovided argument (#2503)
... (truncated)
Commits
59d67efreleasing1.4.11309b07test: update after ChrF removedd95c772build(deps): update huggingface-hub requirement from <0.24 to <0.25 in /requi...683b620text: temp dropChrfimplementation (#2668)83ff38dbuild(deps): update scipy requirement from <1.14.0,>1.0.0 to >1.0.0,<1.15.0 i...72e8304build(deps): bump Lightning-AI/utilities from 0.11.3.post0 to 0.11.6 (#2666)7a66579fix missed f-strings (#2667)98c5456docs: fix broken link32279a6Update_safe_divideto allowAccuracyto run on the GPU (#2640)d214dbebuild(deps): bump lightning-utilities from 0.11.3.post0 to 0.11.5 in /require...- Additional commits viewable in compare view
Updates torchvision from 0.12.0 to 0.19.0
Release notes
Sourced from torchvision's releases.
Torchvision 0.19 release
Highlights
Encoding / Decoding images
Torchvision is extending its encoding/decoding capabilities. For this version, we added a GIF decoder which is available as
torchvision.io.decode_gif(raw_tensor),torchvision.io.decode_image(raw_tensor), andtorchvision.io.read_image(path_to_image).We also added support for jpeg GPU encoding in
torchvision.io.encode_jpeg(). This is 10X faster than the existing CPU jpeg encoder.Stay tuned for more improvements coming in the next versions. We plan to improve jpeg GPU decoding, and add more image decoders (webp in particular).
Resizing according to the longest edge of an image
It is now possible to resize images by setting
torchvision.transforms.v2.Resize(max_size=N): this will resize the longest edge of the image exactly tomax_size, making sure the image dimension don't exceed this value. Read more on the docs!Detailed changes
Bug Fixes
[datasets]
SBDataset: Only download noval file when image_set='train_noval' (#8475) [datasets] Update the download url in classEMNIST(#8350) [io] Fix compilation error when there is nolibjpeg(#8342) [reference scripts] Fix use ofcutmix_alphain classification training references (#8448) [utils] AllowK=1indraw_keypoints(#8439)New Features
[io] Add decoder for GIF images (
decode_gif(),decode_image(),read_image()) (#8406, #8419) [transforms] AddGaussianNoisetransform (#8381)Improvements
[transforms] Allow v2
Resizeto resize longer edge exactly tomax_size(#8459) [transforms] Addmin_areaparameter toSanitizeBoundingBox(#7735) [transforms] Makeadjust_hue()work withnumpy 2.0(#8463) [transforms] Enable one-hot-encoded labels inMixUpandCutMix(#8427) [transforms] Create kernel on-device fortransforms.functional.gaussian_blur(#8426) [io] Adding GPU acceleration toencode_jpeg(10X faster than CPU encoder) (#8391) [io]read_video: acceptBytesIOobjects onpyavbackend (#8442) [io] Add compatibility with FFMPEG 7.0 (#8408) [datasets] Add extra to installgdown(#8430) [datasets] Support encodedRLEformat in forCOCOsegmentations (#8387) [datasets] Added binary cat vs dog classification target type to Oxford pet dataset (#8388) [datasets] Return labels forFER2013if possible (#8452) [ops] Force use oftorch.compileon deterministicroi_alignimplementation (#8436) [utils] add float support toutils.draw_bounding_boxes()(#8328)
... (truncated)
Commits
48b1edfRemove prototype area for 0.19 (#8491)f44f20cUse@release/2.4 instead of@mainfor CI jobs (#8490)143d078Adding GPU acceleration to encode_jpeg (#8391)f96c42fRe-enable vision MPS builds (#8485)f1bcbd3[FBcode->GH] Fix using namespace in pytorch/vision/torchvision/csrc/io/video/...27764a1Skip flaky earth gif test on OSS CI (#8480)b09b3f6Remove unused dynamo import (#8451)375cfdfAdd compatibility with FFMPEG 7.0 (#8408)a839642Load _C ops before registering meta implementations (#8470)bcf6cdaSBDataset: Only download noval file when image_set='train_noval' (#8475)- Additional commits viewable in compare view
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebasewill rebase this PR@dependabot recreatewill recreate this PR, overwriting any edits that have been made to it@dependabot mergewill merge this PR after your CI passes on it@dependabot squash and mergewill squash and merge this PR after your CI passes on it@dependabot cancel mergewill cancel a previously requested merge and block automerging@dependabot reopenwill reopen this PR if it is closed@dependabot closewill close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually@dependabot show <dependency name> ignore conditionswill show all of the ignore conditions of the specified dependency@dependabot ignore <dependency name> major versionwill close this group update PR and stop Dependabot creating any more for the specific dependency's major version (unless you unignore this specific dependency's major version or upgrade to it yourself)@dependabot ignore <dependency name> minor versionwill close this group update PR and stop Dependabot creating any more for the specific dependency's minor version (unless you unignore this specific dependency's minor version or upgrade to it yourself)@dependabot ignore <dependency name>will close this group update PR and stop Dependabot creating any more for the specific dependency (unless you unignore this specific dependency or upgrade to it yourself)@dependabot unignore <dependency name>will remove all of the ignore conditions of the specified dependency@dependabot unignore <dependency name> <ignore condition>will remove the ignore condition of the specified dependency and ignore conditions
[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: Once this PR has been reviewed and has the lgtm label, please assign dimakis for approval. For more information see the Kubernetes Code Review Process.
The full list of commands accepted by this bot can be found here.
Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment
Superseded by #661.