MPT-7B0-Instruct Demo Broken - Out of Memory Error

[MBAnslow]

The web demo on Hugging Face isn't working. There seems to be an OOM error on loading the model.

Environment

Web demo on Hugging Face.

To reproduce

Got to https://huggingface.co/spaces/mosaicml/mpt-7b-instruct

Expected behavior

Demo should be running as usual.

Additional context

[abhi-mosaic]

We are looking into it, thanks for raising!