Tuan T. Pham
Tuan T. Pham
@davedcne : We have a related issue #1521 (Ingestion in parallel with multi-GPU) with pending patch for it. Please try it out and let us know.
**Recap:** * [x]: Multi-GPU in LLM Chat mode works * [x]: Need to apply patch from issue #1521 ; [patch][0] from @SuperSonnix71 [0]: https://gist.github.com/SuperSonnix71/e6ed139497f5176a68960db529e06163
@SuperSonnix71 : your [patch][0] works on my machine in [docker with GPU support and Mixtral 8x7B][1] for 2 Nvidia P40. Thanks for awesome work! [0]: https://gist.github.com/SuperSonnix71/e6ed139497f5176a68960db529e06163 [1]: https://github.com/neofob/privateGPT/tree/tp-docker
@Apotrox : Try to run docker with `--runtime=nvidia`, assuming that you have NVIDIA docker runtime installed and setup. https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html
@LeonHammerla : Check permission of your `/home/worker/app/models/cache/models` of the docker images. Make sure it matches with the user that you are running the docker. I usually run with something like...
@Henrique-Vicentini : Look like you need `gcc` and/or `g++` installed.
CC: @drospond @mishoe @amaruca141 [requirements.txt](https://github.com/dod-advana/gamechanger-ml/files/13353953/requirements.txt) [gamechanger-data_parser_tuan.txt](https://github.com/dod-advana/gamechanger-ml/files/13353958/gamechanger-data_parser_tuan.txt)
> > CC: @drospond @mishoe @amaruca141 > > [requirements.txt](https://github.com/dod-advana/gamechanger-ml/files/13353953/requirements.txt) > > [gamechanger-data_parser_tuan.txt](https://github.com/dod-advana/gamechanger-ml/files/13353958/gamechanger-data_parser_tuan.txt) > > Hey @neofob , > > can you try to install `PyMuPDF==1.17.2` instead of the current version...
> .... > Can you try an alternate approach for me - once you get everything installed on the GC data side you should be able to try to run...
Output from processing one pdf file ``` time python -m common.document_parser pdf-to-json -s /tmp/test-data/AFI-11-405.pdf -d /tmp/test-data-out 2023-11-20 16:47:01,818 - [INFO] - Document Parser has started Memory Hard Limit: -1 Soft...