MOSS RuntimeError: CUDA out of memory

安装完成第一次运行时报错，ubuntu2204/nvidia T4卡x2 。是要切换量化等级吗？

$python moss_cli_demo.py Fetching 17 files: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 17/17 [00:00<00:00, 212211.81it/s] Waiting for all devices to be ready, it may take a few minutes... Traceback (most recent call last): File "moss_cli_demo.py", line 31, in model = load_checkpoint_and_dispatch( File "/home/good/anaconda3/envs/moss/lib/python3.8/site-packages/accelerate/big_modeling.py", line 479, in load_checkpoint_and_dispatch load_checkpoint_in_model( File "/home/good/anaconda3/envs/moss/lib/python3.8/site-packages/accelerate/utils/modeling.py", line 946, in load_checkpoint_in_model set_module_tensor_to_device(model, param_name, param_device, value=param, dtype=dtype) File "/home/good/anaconda3/envs/moss/lib/python3.8/site-packages/accelerate/utils/modeling.py", line 149, in set_module_tensor_to_device new_value = value.to(device) RuntimeError: CUDA out of memory. Tried to allocate 288.00 MiB (GPU 1; 14.62 GiB total capacity; 13.28 GiB already allocated; 243.38 MiB free; 13.30 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF