wirthual
wirthual
Thanks for trying, can you try to downgrade click: ``` pip install click==8.1.8 ```
Ran it with `transformers > 4.49` on my local setup. Did not see the expected speedup. Need to investigate further.
Running the benchmark of this branch using GPU on my local machine I got the following results: `336s` with vs `529s` without transformers version: `4.53.3` ## Details ### Without bettertransformer:...
Pin them to `
I think you are right, bumping `typer` helps. Typer `0.12.5` with `click==8.3.0` raises this error, when bumping `typer` to the latest version(`0.20.0`), the error is gone.
Hi, thank you for reporting this. Related issue: https://github.com/michaelfeil/infinity/issues/598 Until a new docker image is released, you should be able to build a custom docker image by following the suggestions...
Infinity creates its own virtual environment inside the container, so try to run it from `/app/.venv/bin/python3.10`: ```bash root@448acd6fd689:/app# /usr/bin/python3.10 -m infinity_emb Traceback (most recent call last): File "/usr/lib/python3.10/runpy.py", line 187,...
Hi @rawsh , This seems to be the same issue as #325 I managed to get this model running by setting the architecture type to `JinaBertForSequenceClassification` and an additonal parameter...
@calvin2021y You have any update on this issue or can this be considered closed?
Hi, is there a good example model which makes use of instructions?