metavoice-src
metavoice-src copied to clipboard
Windows fixes
@addictivepixels thanks! a few merge conflicts, but @sidroopdaska will review soon o/w.
this doesn't fix windows support as torch.compile is not supported on windows, so fast_inference_utils will need to be reworked
@noita-player, can you assist here?
my hack to run on windows via disabling torch.compile and triton flags resulted in 40sec gen times on a 4080 so IMO windows support should just be blocked by the huge perf wins: https://github.com/openai/triton/issues/1640 https://github.com/pytorch/pytorch/issues/122094