OpenAssistant_API_Pythia_12B icon indicating copy to clipboard operation
OpenAssistant_API_Pythia_12B copied to clipboard

Published 20 hours ago • verified publisher icon Sentdex

Ubuntu Server 20.04 says "Killed"

Open webmasterandy opened this issue 2 years ago • 3 comments
trafficstars

I run the file oasstapiv1.py. All downloads have been made. And then it just says "Killed". No idea if there is a log file somewhere. I am using Ubuntu 20.04 Server with 16.00GiB RAM and 2000MHz AMD EPIC CPU with 6 cores.

webmasterandy avatar Jun 16 '23 17:06 webmasterandy

Same issue

image

vedantkingh avatar Jul 26 '23 17:07 vedantkingh

You're both almost certainly running out of memory. These scripts are assuming GPU memory, so if you're intending to use CPU/RAM be sure to change that, and/or make sure you have enough memory in general to run this model.

Sentdex avatar Jul 26 '23 19:07 Sentdex

Let's say I decide to get a cloud VM to run this API for testing, what configuration of the Cloud VM should I take so that it doesn't crash?

vedantkingh avatar Jul 27 '23 08:07 vedantkingh