Multimodal-Toolkit icon indicating copy to clipboard operation
Multimodal-Toolkit copied to clipboard

Published 20 hours ago • verified publisher icon georgian-io

newest transformers broken MT

Open p4w3l opened this issue 6 months ago • 2 comments

Hi,

The latest transformers 4.52.1 make some breaks. I have error importing:

from multimodal_transformers.data import load_data_from_folder

ImportError: cannot import name 'BERT_INPUTS_DOCSTRING' from 'transformers.models.bert.modeling_bert' (/opt/conda/lib/python3.11/site-packages/transformers/models/bert/modeling_bert.py)

Using transformers==4.51.3 fixes the issue.

regards Paweł

p4w3l avatar May 21 '25 08:05 p4w3l

Yes, I notice this as well. Its because transformers >= 4.51.3 removed the docstrings from BERT. Can be fixed by removing the corresponding references here: https://github.com/georgian-io/Multimodal-Toolkit/blob/master/multimodal_transformers/model/tabular_transformers.py

harsh-dialpad avatar May 21 '25 18:05 harsh-dialpad

Even worse: With the newest dependencies logits returns NaNs or huge loss. Finally I fixed it by downgrading a list of dependencies:

transformers==4.44.2 torch==2.3.0 datasets==2.20.0 scikit-learn==1.5.1

p4w3l avatar May 25 '25 15:05 p4w3l