huggingface
Limit PyTorch version
optimum-cli export openvino -m tiiuae/falcon-7b --weight-format int4 falcon-7b-ov-int4 results in an error with PyTorch 2.4 on Windows: The specified module could not be found. Error loading "[...]fbgem.dll" or one of its dependencies.
IPEX installs a lower version of PyTorch already so this change should be safe while we look into this.
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
@helena-intel I suppose issue notiwith specific pytorch version, I found this thread related to your reported issue https://discuss.pytorch.org/t/failed-to-import-pytorch-fbgemm-dll-or-one-of-its-dependencies-is-missing/201969/2 and it was reported in may, when torch 2.3 released. I suppose the recommendation for fixing that should be not limit pytorch version, but update VS C++ package
@helena-intel I suppose issue notiwith specific pytorch version, I found this thread related to your reported issue https://discuss.pytorch.org/t/failed-to-import-pytorch-fbgemm-dll-or-one-of-its-dependencies-is-missing/201969/2 and it was reported in may, when torch 2.3 released. I suppose the recommendation for fixing that should be not limit pytorch version, but update VS C++ package
That is annoying. Many of our Windows customers will run into this. But for me the issue was fixed after installing PyTorch 2.3, otherwise I would not have made the PR. I see that most of the comments from that issue are also from after the PyTorch 2.4 release so it seems possible there's a relationship.