torchopt
torchopt copied to clipboard
TorchOpt is an efficient library for differentiable optimization built upon PyTorch.
## Describe the bug I have trouble installing optree from pypi on our compute clusters, getting undefined symbol errors. I saw [this link to an optree github repo](https://github.com/metaopt/optree) on [pypi](https://pypi.org/project/optree/),...
## Motivation Adan optimizer is a big hit recently, good feature to support for meta learning research ## Resource - paper: https://arxiv.org/abs/2208.06677 - source code: https://github.com/sail-sg/Adan ## Roadmap - [...
## Questions It seems that optimizers like torchopt.adam does not support torch.optim.lr_scheduler ## Checklist - [x] I have checked that there is no similar issue in the repo (**required**) -...
## Motivation MacOS and Windows support. ## Solution Update `CMakeList.txt` and `cibuildwheel`. ## Checklist - [X] I have checked that there is no similar issue in the repo (**required**)
Bumps [pypa/cibuildwheel](https://github.com/pypa/cibuildwheel) from 2.16 to 2.17. Release notes Sourced from pypa/cibuildwheel's releases. v2.17.0 🌟 Adds the ability to inherit configuration in TOML overrides. This makes certain configurations much simpler. If...
updates: - [github.com/astral-sh/ruff-pre-commit: v0.1.9 → v0.2.0](https://github.com/astral-sh/ruff-pre-commit/compare/v0.1.9...v0.2.0) - [github.com/psf/black: 23.12.1 → 24.1.1](https://github.com/psf/black/compare/23.12.1...24.1.1) - [github.com/pycqa/flake8: 6.1.0 → 7.0.0](https://github.com/pycqa/flake8/compare/6.1.0...7.0.0)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 3 to 4. Release notes Sourced from codecov/codecov-action's releases. v4.0.0 v4 of the Codecov Action uses the CLI as the underlying upload. The CLI has helped to...
### Required prerequisites - [X] I have searched the [Issue Tracker](https://github.com/metaopt/torchopt/issues) and [Discussions](https://github.com/metaopt/torchopt/discussions) that this hasn't already been reported. (+1 or comment there if it has.) - [X] Consider asking...
## Description Describe your changes in detail. ## Motivation and Context Why is this change required? What problem does it solve? If it fixes an open issue, please link to...
## Description `adan` optimizer integration ## Roadmap - [ ] low-level alias - [ ] high-level `Optimizer` - [ ] high-level `MetaOptimizer` - [ ] low-level alias test - [...