FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard

Flagembedding 1.3.4 incompatible with transformers 4.52.

Open jesnie opened this issue 7 months ago • 2 comments

It looks like Flagembedding 1.3.4 incompatible with transformers 4.52. I get:

.venv/lib/python3.12/site-packages/FlagEmbedding/__init__.py:1: in <module>
    from .inference import *
.venv/lib/python3.12/site-packages/FlagEmbedding/inference/__init__.py:2: in <module>
    from .auto_reranker import FlagAutoReranker
.venv/lib/python3.12/site-packages/FlagEmbedding/inference/auto_reranker.py:5: in <module>
    from FlagEmbedding.inference.reranker.model_mapping import (
.venv/lib/python3.12/site-packages/FlagEmbedding/inference/reranker/__init__.py:1: in <module>
    from .decoder_only import FlagLLMReranker, LayerWiseFlagLLMReranker, LightWeightFlagLLMReranker
.venv/lib/python3.12/site-packages/FlagEmbedding/inference/reranker/decoder_only/__init__.py:3: in <module>
    from .lightweight import LightweightLLMReranker as LightWeightFlagLLMReranker
.venv/lib/python3.12/site-packages/FlagEmbedding/inference/reranker/decoder_only/lightweight.py:13: in <module>
    from .models.gemma_model import CostWiseGemmaForCausalLM
.venv/lib/python3.12/site-packages/FlagEmbedding/inference/reranker/decoder_only/models/gemma_model.py:56: in <module>
    from transformers.models.gemma2.modeling_gemma2 import Gemma2MLP, repeat_kv, Gemma2Attention, Gemma2DecoderLayer, GEMMA2_START_DOCSTRING
E   ImportError: cannot import name 'GEMMA2_START_DOCSTRING' from 'transformers.models.gemma2.modeling_gemma2' (.venv/lib/python3.12/site-packages/transformers/models/gemma2/modeling_gemma2.py)

jesnie avatar May 21 '25 09:05 jesnie

FlagEmbedding==1.3.4andtransformers==4.46.1is compatible

Lightning-Lion avatar May 27 '25 07:05 Lightning-Lion

Thank you for providing the information. We have updated the GitHub repository, and you can resolve the issue by running pip install again.

545999961 avatar May 28 '25 07:05 545999961