Seyyed Ali Ayati
Seyyed Ali Ayati
> > > maybe because of CPU OOM ? > > > > > > Can you provide more details please? > > I watch my RAM reaching 256g/256g, then...
I have upgraded my GPUs to A100 40GB of memory but I still have the same issue :( Could you please help me? @lxuechen @rtaori
> he correct parameters are loaded from the model file So, why I get this error? If you need more information, please let me know. Thanks.
I just re-run and now I get this: ```bash (base) ali@host:~/ggml$ python examples/starcoder/convert-hf-to-ggml.py bigcode/starcoder Loading model: bigcode/starcoder Downloading (…)l-00001-of-00007.bin: 100%|█████████████████████████████████████████| 9.90G/9.90G [05:09
> I'm afraid you may be lacking system memory for the conversion. You are right. I have increased my RAM and issue solved!