kairon
kairon copied to clipboard
Bump transformers from 4.23.0 to 4.26.1
Bumps transformers from 4.23.0 to 4.26.1.
Release notes
Sourced from transformers's releases.
V4.26.1: Patch release
- ESM openfold_utils type hints by
@ringohoffman
in #20544- Add cPython files in build by
@sgugger
in #21372- Fix T5 inference in float16 + bnb error by
@younesbelkada
in #21281- Fix import in Accelerate for find_exec_bs by
@sgugger
in #21501- Fix inclusion of non py files in package by
@sgugger
in #21546v4.26.0: Generation configs, image processors, backbones and plenty of new models!
GenerationConfig
The
generate
method has multiple arguments whose defaults were lying in the model config. We have now decoupled these in a separate generation config, which makes it easier to store different sets of parameters for a given model, with different generation strategies. While we will keep supporting generate arguments in the model configuration for the foreseeable future, it is now recommended to use a generation config. You can learn more about its uses here and its documentation here.
- Generate: use
GenerationConfig
as the basis for.generate()
parametrization by@gante
in #20388- Generate: TF uses
GenerationConfig
as the basis for.generate()
parametrization by@gante
in #20994- Generate: FLAX uses
GenerationConfig
as the basis for.generate()
parametrization by@gante
in #21007
ImageProcessor
In the vision integration, all feature extractor classes have been deprecated to be renamed to
ImageProcessor
. The old feature extractors will be fully removed in version 5 of Transformers and new vision models will only implement theImageProcessor
class, so be sure to switch your code to this new name sooner rather than later!
- Add deprecation warning when image FE instantiated by
@amyeroberts
in #20427- Vision processors - replace FE with IPs by
@amyeroberts
in #20590- Replace FE references by
@amyeroberts
in #20702New models
AltCLIP
AltCLIP is a variant of CLIP obtained by switching the text encoder with a pretrained multilingual text encoder (XLM-Roberta). It has very close performances with CLIP on almost all tasks, and extends the original CLIP’s capabilities to multilingual understanding.
BLIP
BLIP is a model that is able to perform various multi-modal tasks including visual question answering, image-text retrieval (image-text matching) and image captioning.
- Add BLIP by
@younesbelkada
in #20716BioGPT
BioGPT is a domain-specific generative pre-trained Transformer language model for biomedical text generation and mining. BioGPT follows the Transformer language model backbone, and is pre-trained on 15M PubMed abstracts from scratch.
- Add BioGPT by
@kamalkraj
in #20420BiT
BiT is a simple recipe for scaling up pre-training of ResNet-like architectures (specifically, ResNetv2). The method results in significant improvements for transfer learning.
- Add BiT + ViT hybrid by
@NielsRogge
in #20550
... (truncated)
Commits
ae54e3c
Fix inclusion of non py files in package (#21546)865bb4e
Fix import in Accelerate for find_exec_bs (#21501)02c3f41
Release: v4.26.11139260
[t5
] Fix T5 inference infloat16
+bnb
error (#21281)38620e1
Add cPython files in build (#21372)820c46a
Hotifx remove tuple for git config image processor. (#21278)a280cdd
Fix MaskFormerImageProcessor.post_process_instance_segmentation (#21256)baf0df1
Release: v4.26.0fd5cdae
Models docstring (#21225)9e86c4e
Supported pipeline tasks update (#21268)- Additional commits viewable in compare view
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase
.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
-
@dependabot rebase
will rebase this PR -
@dependabot recreate
will recreate this PR, overwriting any edits that have been made to it -
@dependabot merge
will merge this PR after your CI passes on it -
@dependabot squash and merge
will squash and merge this PR after your CI passes on it -
@dependabot cancel merge
will cancel a previously requested merge and block automerging -
@dependabot reopen
will reopen this PR if it is closed -
@dependabot close
will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually -
@dependabot ignore this major version
will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) -
@dependabot ignore this minor version
will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) -
@dependabot ignore this dependency
will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)