Vladimir Krutikov

I added the lines: print(sys.platform) print(torch.backends.mps.is_available()) After the lines: If device == "mps": torch_dtype = torch.float16 else: torch_dtype = torch.bfloat16 Result in console: darwin True

This variant doesn't change anything, as the text generation itself doesn't seem to be affected in any way, if there are more than a certain number of characters, it starts...