Tim Baumgärtner

Results 28 comments of Tim Baumgärtner

> pip list | grep nccl to check if you have two versions, you should remove the unnecessary one Thanks for the suggestion @ywglf. `pip list | grep nccl` shows...

> Seen this problem as well. A solution that worked for me was to set the number of intra_op_num_threads to something corresponding to the number of available cores: > >...

Hi @kermitt2, I am using grobid 0.7.3. `./gradlew --version` gives the following: ``` ------------------------------------------------------------ Gradle 7.2 ------------------------------------------------------------ Build time: 2021-08-17 09:59:03 UTC Revision: a773786b58bb28710e3dc96c4d1a7063628952ad Kotlin: 1.5.21 Groovy: 3.0.8 Ant: Apache...

Thanks for getting back! No worries, I am using python 3.8.2 meanwhile. I am on an Intel i5.

Phi-3 small and medium seem to be working, but not mini. Phi-3-mini uses "longrope" as rope_scaling type (https://huggingface.co/microsoft/Phi-3-mini-128k-instruct/blob/main/config.json#L128), while Phi-3-small and Phi-3-medium use "su" (https://huggingface.co/microsoft/Phi-3-small-128k-instruct/blob/main/config.json#L180). Not too familiar with these...

The download only on request is a good feature I think, as long as the current logic deploys all models at once. Otherwise there will be many models downloaded and...