insanely-fast-whisper icon indicating copy to clipboard operation
insanely-fast-whisper copied to clipboard

Published 20 hours ago • verified publisher icon Vaibhavs10

torch_dtype only for torch.float16？

Open yumianhuli1 opened this issue 1 year ago • 0 comments

Does inference currently only support torch_dtype=torch.float16？int8_float16、int8 will be supported？

yumianhuli1 avatar Feb 04 '24 07:02 yumianhuli1