Siddhant Ojha

I am also facing this. How did you solve it ?

This is another error I came across KeyError: 'blocks.0.hook_resid_mid' Traceback: File "/home/user/mambaforge3/envs/llmtt/lib/python3.12/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 600, in _run_script exec(code, module.__dict__) File "/home/user/llm-transparency-tool/llm_transparency_tool/server/app.py", line 699, in app.run() File "/home/user/llm-transparency-tool/llm_transparency_tool/server/app.py", line 683, in run...

I think it wont work if the model is not there on hugging face hub as it is taking cfg from hugging face

This is the error I am getting, but I feel this can work. Is there any solution for this ? `RuntimeError: Error(s) in loading state_dict for HookedTransformer:   size mismatch for...

> Maybe another solution would be to let people pass `hf_config` as an argument 🤔 > > But then we'd have to make the `elif architecture == "MistralForCausalLM":` case use...