Lemur icon indicating copy to clipboard operation
Lemur copied to clipboard

Published 20 hours ago • verified publisher icon OpenLemur

GPU

Open Sun9893 opened this issue 1 year ago • 2 comments

how much RAM is needed to run Lemur?

Sun9893 avatar Aug 26 '23 12:08 Sun9893

same question ...

MahdiMohseni0033 avatar Oct 14 '23 10:10 MahdiMohseni0033

With load_in_8_bit, usually it requires (at least) 1 x 80G A100 to do inference on the model. @MahdiMohseni0033

SivilTaram avatar Oct 18 '23 02:10 SivilTaram