WizardLM icon indicating copy to clipboard operation
WizardLM copied to clipboard

Huggingface space replication lagging

Open kafischer opened this issue 1 year ago • 2 comments

I created a NF space with the biggest Nvidia A100 - but don't seem to be getting any completions

Any suggestions for how to try out?

image

kafischer avatar Apr 26 '23 16:04 kafischer

1.Make sure your API credentials are set up correctly 2.Check that your input prompt is formatted correctly and is appropriate for the model 3.Make sure the model is selected correctly and has enough capacity to generate a response. The biggest Nvidia A100 should have plenty of capacity, but double-check that you're using the correct model. 4.If you're still not getting any responses, try adjusting the "temperature" parameter of the model.

murali1999-tech avatar May 01 '23 13:05 murali1999-tech

Hey, can this issue be closed? Did you manage to get completions?

haiatn avatar Sep 24 '23 18:09 haiatn