Benjamin Bossan
Benjamin Bossan
**Describe the bug** Using multiple `# fmt: skip` in the same expression causes an `INTERNAL ERROR`. **To Reproduce** The first example (`a`) works but all others fail: ```python a =...
As discussed internally, we want to automatically cast the weights of the adapter to `float32` when using `float16`. `float16` is not conducive to stable training and raises errors when used...
These are very basic and simplistic regression tests for bnb. Their purpose is to ensure that there is no unnoticed change in bnb that leads to different outputs. There is...
First stab at adding LoRA support for `nn.MultiheadAttention`. See #761. Todos: - [x] ~~For now, only works with `_qkv_same_embed_dim=True` -- make it work with `False` too.~~ `_qkv_same_embed_dim=False` is out of...
It seems that there no longer is a proper description on pypi: https://pypi.org/project/dstoolbox/ https://pypi.python.org/pypi/dstoolbox Not sure if this is related to the recent changes in pypi or whether a change...
This does not work but should: `ItemSelector(np.s_[:10, :5]).fit_transform(np.zeros((12, 18)))`
Document the PEFT checkpoint format, with a focus on how to convert to this format. [Link to rendered docs](https://moon-ci-docs.huggingface.co/docs/peft/pr_1717/en/developer_guides/checkpoint#checkpoint-format). This is a bit of a brain dump, so let me...
Fixes #1732 After loading a model that was trained with PEFT on a base model with some kind of batch norm layer, the loaded model should produce the same output....
Preparing for release of PEFT v0.11.0. AFAICT, there are no deprecations for this release.
### System Info Latest version of PEFT ### Who can help? _No response_ ### Information - [ ] The official example scripts - [ ] My own modified scripts ###...