transformers icon indicating copy to clipboard operation
transformers copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

[WIP] [deepspeed] from_pretrained deal with ignore_mismatched_sizes

Open stas00 opened this issue 3 years ago • 3 comments

An attempt to fix the issue reported https://github.com/huggingface/transformers/issues/17336

Fixes: https://github.com/huggingface/transformers/issues/17336

stas00 avatar May 20 '22 21:05 stas00

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

HuggingFaceDocBuilderDev avatar May 20 '22 21:05 HuggingFaceDocBuilderDev

After creating a test I discovered it breaks on tied variables since they get ignored in model.named_parameters - so back to the drawing table.

stas00 avatar May 25 '22 04:05 stas00