tamil-llama

tamil-llama copied to clipboard

Regarding Training of Model

1

We are currently working on a project where we want to finetune the current Tamil lama model to create an application for a domain specific use, which requires specialised vocabulary...

Cyberblackstone

for Malayalam

SmartManoj

getting error when pretraining.

2

im getting this error for my training script, ` File "/usr/local/lib/python3.10/dist-packages/peft/tuners/lora.py", line 356, in forward result = F.linear(x, transpose(self.weight, self.fan_in_fan_out), bias=self.bias) RuntimeError: mat1 and mat2 shapes cannot be multiplied (32768x4096...

sazzad1779