unsloth icon indicating copy to clipboard operation
unsloth copied to clipboard

Published 20 hours ago • verified publisher icon unslothai

RuntimeError: User specified an unsupported autocast device_type 'meta'

Open brand17 opened this issue 8 months ago • 4 comments

I am getting this error on inference stage wiht llama-3-8b if set load_in_4bit = False: https://colab.research.google.com/drive/1RUzN1ZNjuDi4y-HyT2W9v7ePM3tLI-Lo#scrollTo=QmUBVEnvCDJv

brand17 avatar Jun 23 '24 13:06 brand17