"expected scalar type BFloat16 but found Half"

[j2l]

Tried your fork to run your model https://huggingface.co/OccamRazor/mpt-7b-storywriter-4bit-128g/

Using it locally, this model throws the error expected scalar type BFloat16 but found Half

IDK what to do to fix this. Would you please let me know if it works for you or how to fix this? Attached is debug and config.json: debug.zip

Thanks