llm-foundry icon indicating copy to clipboard operation
llm-foundry copied to clipboard

Published 20 hours ago • verified publisher icon mosaicml

Fix autocast dtype

Open abhi-mosaic opened this issue 2 years ago • 0 comments

Minor bug, we can't pass devices like torch.device('cuda:0') into the autocast funciton. Instead you need to pass torch.device('cuda:0').type which is 'cuda'.

Tested on an interactive instance.

abhi-mosaic avatar Jun 08 '23 16:06 abhi-mosaic