parrots icon indicating copy to clipboard operation
parrots copied to clipboard

Published 20 hours ago • verified publisher icon shibing624

大佬您好，关于显存释放问题

Open ganjunhong opened this issue 11 months ago • 1 comments

大佬您好，执行完m.predict(）推理以后，显存是不会立马释放掉，请问如何可以释放掉显存占用。

ganjunhong avatar Mar 01 '24 13:03 ganjunhong

批量执行多次predict后，使用 torch.cuda.empty_cache()

shibing624 avatar Mar 02 '24 03:03 shibing624