Yijiang Kris Liu comments

Repositories
Issues
Comments

Results 4 comments of


                                            Yijiang Kris Liu

OOM issue

4x A100-80GB is ok, and gpu memory is almost fully allocated...

OOM issue

> > 4x A100-80GB is ok, and gpu memory is almost fully allocated... > > can i train using only 1 A100-80G? i've no idea. maybe you can have a...

AttributeError: module 'llama' has no attribute 'LLaMATokenizer' when using example

installing the environment as described in the facebook repo solves the problem: https://github.com/facebookresearch/llama

GPU hardware for inference

for inference, it's like a 26GB VRAM card. for training, when i use 48GB, unfortunately, OOM.... still trying~ if you find proper devices, please tell me.