Akshara Prabhakar
Results
2
comments of
Akshara Prabhakar
> i am try fix it on examples/starcoder/main.cpp line 849 add: > > ``` > else if (model.hparams.n_layer >= 40 && embd.back() == 49155) { //TODO: this is only for...
The experts are LoRA finetuned Llama 7B models with target modules ['down_proj', 'v_proj', 'up_proj', 'q_proj', 'k_proj'] and this was the error encontered `Traceback (most recent call last): ... File "/lib/python3.10/site-packages/torch/nn/modules/linear.py",...