FlagEmbedding
FlagEmbedding copied to clipboard
Flagembedding 1.3.4 incompatible with transformers 4.52.
It looks like Flagembedding 1.3.4 incompatible with transformers 4.52. I get:
.venv/lib/python3.12/site-packages/FlagEmbedding/__init__.py:1: in <module>
from .inference import *
.venv/lib/python3.12/site-packages/FlagEmbedding/inference/__init__.py:2: in <module>
from .auto_reranker import FlagAutoReranker
.venv/lib/python3.12/site-packages/FlagEmbedding/inference/auto_reranker.py:5: in <module>
from FlagEmbedding.inference.reranker.model_mapping import (
.venv/lib/python3.12/site-packages/FlagEmbedding/inference/reranker/__init__.py:1: in <module>
from .decoder_only import FlagLLMReranker, LayerWiseFlagLLMReranker, LightWeightFlagLLMReranker
.venv/lib/python3.12/site-packages/FlagEmbedding/inference/reranker/decoder_only/__init__.py:3: in <module>
from .lightweight import LightweightLLMReranker as LightWeightFlagLLMReranker
.venv/lib/python3.12/site-packages/FlagEmbedding/inference/reranker/decoder_only/lightweight.py:13: in <module>
from .models.gemma_model import CostWiseGemmaForCausalLM
.venv/lib/python3.12/site-packages/FlagEmbedding/inference/reranker/decoder_only/models/gemma_model.py:56: in <module>
from transformers.models.gemma2.modeling_gemma2 import Gemma2MLP, repeat_kv, Gemma2Attention, Gemma2DecoderLayer, GEMMA2_START_DOCSTRING
E ImportError: cannot import name 'GEMMA2_START_DOCSTRING' from 'transformers.models.gemma2.modeling_gemma2' (.venv/lib/python3.12/site-packages/transformers/models/gemma2/modeling_gemma2.py)
FlagEmbedding==1.3.4andtransformers==4.46.1is compatible
Thank you for providing the information. We have updated the GitHub repository, and you can resolve the issue by running pip install again.