0xDigest
0xDigest
Thanks for the quick reply- Honestly, I've just started with langchain, I haven't seen any instances of multiple values in the prompt list, yet. I did go ahead and patch...
Thanks for the quick turnaround. I've updated and can confirm this works as expected.
If it helps, I updated the Dockerfile to use nvcr.io/nvidia/pytorch:23.05-py3 and was able to load the [model](https://huggingface.co/tiiuae/falcon-40b) [referenced above](https://github.com/hyperonym/basaran/issues/204#issuecomment-1579816548) and run inference. I can confirm that it runs slow for...