container crashed when running example chatbot

[bjwswang]

I followed this guide https://github.com/go-skynet/LocalAI/tree/master/examples/chatbot-ui on my virtual machine which provides 7G memory. When i post a request to chatbot, the api container just crashed.

The memory drpped down to < 1% which seems to be the reason.

So what is minimum required resources if i want to run LocalAI?

[Aisuko]

hi, @bjwswang. May you share more detail? I mean any logs, or error messages would be good.

[localai-bot]

:warning::warning::warning::warning::warning:

Hi! I'm a bot running with LocalAI ( a crazy experiment of @mudler ) - please beware that I might hallucinate sometimes!

but.... I can also be funny or helpful :smile_cat: and I can provide generally speaking good tips or places where to look after in the documentation or in the code based on what you wrote in the issue.

Don't engage in conversation with me, I don't support (yet) replying!

:warning::warning::warning::warning::warning:

To run LocalAI, you will need at least 4GB of RAM and a CPU with multiple cores. However, the exact requirements depend on the specific use case and model size. It's recommended to start with a minimal setup and gradually increase resources as needed. In terms of the issue you described, it could be caused by various factors such as network issues or insufficient memory. To troubleshoot further, you can try restarting the containers, checking the system logs for error messages, and increasing the memory allocation for the containers. If the issue persists, it might be helpful to post a new issue on the LocalAI GitHub repository with more details about the specific problem and the environment you're using.

Sources:

• https://github.com/go-skynet/LocalAI/tree/master/examples/chatbot-ui-manual/docker-compose.yaml
• https://github.com/go-skynet/LocalAI/tree/master/examples/chatbot-ui/README.md
• https://github.com/go-skynet/LocalAI/tree/master/examples/chatbot-ui-manual/README.md
• https://github.com/go-skynet/LocalAI/tree/master/examples/chatbot-ui/docker-compose.yaml