dinuthomas

Finally worked for me after doing this, 1. pip uninstall ffmpeg-python 2. pip3 install ffmpeg-python So try installing with pip3..

I guess the code is specifically checking for the keys "base_model.model.model.layers.\*", while the "offload" files are with the starting name "model.layers.\*.dat". Somewhere, the key prefixes ("base_model.model.") are not coded properly...