We Need Docker!!

[HRNPH]

This is a hassle to install, would be easier with docker compose or dockerfile docker image or anything

[HRNPH]

กูทำเองก็ได้ wah :b

[munchtoast]

as stated in our conversation I can take a look at this once we have reworked chat system. vllm containers works with PygmalionAI and nvidia runtime.