RobinLi7

RuntimeError with Shared Tensors in DNABERT-2-117M Configuration Using run_mlm.py

3

RuntimeError: The weights trying to be saved contained shared tensors [{'cls.predictions.decoder.weight', 'bert.embeddings.word_embeddings.weight'}] that are mismatching the transformers base configuration. Try saving using `safe_serialization=False` or remove this tensor sharing. When I...

Can we use BertForMaskedLM to load the pretrained model instead of AutoModelForMaskedLM?