Raushan Turganbay

Blip: get/set input embeddings correctly

3

# What does this PR do? Fixes https://github.com/huggingface/transformers/issues/34109 and adds `get_input_embeddings` method to the retrieval model. Also fixes the same methods in BLIP model where we should be working with...

VLM: add more modularity

1

# What does this PR do? As mentioned in https://github.com/huggingface/transformers/issues/33948, this PR simply refactors code a bit to make it more modular, Specifically we now will have special public methods...

# What does this PR do? Precedes https://github.com/huggingface/transformers/pull/34174/files. Before merging the linked PR, we need to stop relying on `main_input_name` as in some cases (BLIP) the main input is not...

VLMs: `patch_size` -> `num_image_tokens` in processing

9

# What does this PR do? Following https://github.com/huggingface/transformers/issues/33374, we'll use `num_image_tokens` instead of `patch_size` VLM in processors. The reason is because some image backbones add a CLS token while other...

# What does this PR do? Same as https://github.com/huggingface/transformers/pull/33754, I accidentally force pushed to wrong branch and the PR got closed 🙃