Could you please add Dockerfile, docker-compose, helper scripts ?

[gwpl]

Could you please add

• [ ] Dockerfile
• [ ] docker-compose.yml
• [ ] helper scripts (e.g. Makefile with targets "localGPT-cpu" "localGPT-gpu" "localGPT_API-cpu" "localGPT_API-gpu" "up" "up-build" "ingest") ?

I gave a shot to make some, and everytime I try to test it it downloads again pytorch_model.bin and also not really runs...

Here are files I ended up using , and you may continue conversation to ask GPT-4 for adjustements to files: https://chat.openai.com/share/a3622816-ce00-455e-a178-a75791555e5a

Sorry I didn't spend more time on debugging it, I just had a moment to give it a fast shot.

I believe that shipping your software with Docker and scripts and easy to run targets will help a lot in adoption (and e.g. having AUR package https://aur.archlinux.org/packages/ or SNAP https://snapcraft.io/install/snap-store/ubuntu for easy distribution!).