keurcien

icon indicating a website link https://stackoverflow.com/users/8253769/kluu

icon company @appchoose icon location Paris icon location Ph.D. Graduated from ENS Cachan with a major in mathematics. Statistics with large data sets, python/R, population genetics.

Results 1 comments of keurcien

Getting OOM Error for finetuning Falcon-7b Model in 80GB A100 GPU with Custom Data.

Had the same issue today, tried to run finetune/adapter_v2 for Falcon 7B on a NVIDIA L4 (24 GB RAM) ``` Loading model 'checkpoints/tiiuae/falcon-7b/lit_model.pth' with {'org': 'tiiuae', 'name': 'falcon-7b', 'block_size': 2048,...