RWKV-Runner
RWKV-Runner copied to clipboard
启动模型报错:failed to load: MPS backend out of memory
启动模型(MAC-3B-World/Mac-7B-World)时报错: 切换模型失败 - {"detail":"failed to load: MPS backend out of memory (MPS allocated: 6.75 GB, other allocations: 332.00 KB, max allowed: 6.80 GB). Tried to allocate 87.50 MB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure)."}
环境: Macbook Pro 15 处理器:2.4 GHz 八核Intel Core i9 图形卡:Radeon Pro 560X 4 GB Intel UHD Graphics 630 1536 MB 内存:32 GB 2400 MHz DDR4 macOS:13.4.1 (c) (22F770820d)
google 查到一些方法,但介绍的不具体,不知道在RWKV-Runner项目中该怎么改,请知道的人指点。谢谢!
直接用WebGPU模式