ChatRWKV icon indicating copy to clipboard operation
ChatRWKV copied to clipboard

feat: docker support

Open soulteary opened this issue 2 years ago • 3 comments
trafficstars

Related documents and introductions will be added later. :D

Guide & Blog: https://zhuanlan.zhihu.com/p/616986651

soulteary avatar Mar 25 '23 10:03 soulteary

This is great - I am attempting to stand up docker-ChatRWKV.git. I have a request:

Add ability to use local model path

I have several RWKV models already downloaded, and I want to use them with the docker container. My local VM has limited disk space, and my internet connection is slow.

Adding ability to use local model from a file path would make the docker image more useful to people like me

I will attempt to hack the Dockerfile, but it would be great if this was an option. I think it would let a lot more people see RWKV.

tensiondriven avatar Apr 23 '23 17:04 tensiondriven

@tensiondriven

Correct me if I am wrong, I don't think docker mount point support symbolic link, so you would need to mount the actual model path.

yhyu13 avatar May 03 '23 14:05 yhyu13

I think you are right. Thank you, I'll give it a try.

tensiondriven avatar May 03 '23 14:05 tensiondriven