Bryce Meyer
Bryce Meyer
@po13on in order to investigate this further, I am going to need to see exactly the code you used to initialize TransformerLens. This bug could be a wide ranging bug,...
No problem! Thanks for providing this. This should be enough for us to recreate it now.
@JuVogt Do you have time to handle this issue?
Could you share the code you are using to load TransformerLens? You should be able to pass in your local version of the model with the param `hf_model`
What error did you receive when you ran this in TransformerLens?
You should be able to load that model without issues. If you are getting memory errors, then my best guess is that there is something else running that is causing...
Thank you for spending the time working on this. I do think there is value in this, however I think it should be changed slightly. On the notebook tests, I...
I reviewed the results you referenced, and I have a few thoughts here. The tests that you ran were all done on python 3.8, 3.9, and 3.10. After looking around...
Yeah I did some digging earlier in the day as well, and as you have deduced it seems like MPS is simply not possible at this time. I am not...
I think this could be a very useful thing to add