Nicolas Patry comments

Results 978 comments of


                                            Nicolas Patry

Unable to download tokenizer. S3 link seems to be inaccessible

Last commit is from 3 years ago...

Unable to download tokenizer. S3 link seems to be inaccessible

Definitely not actively maintained. `tokenizers` and its node bindings are, but they are in maintenance mode only (until someone wants to help redo the bindings with latest neon)

Unable to download tokenizer. S3 link seems to be inaccessible

@Pierrci Are you ok with archiving this ?

Replace constrained strings (model/task names...) with enums.

Hi, for the whole I/O thing, I want to mention we have 1 document at least for pipelines: https://www.notion.so/huggingface2/Pipelines-Guidelines-1de828d4e56e4adb886253440657e13a (Just so that we can try and share some definitions amongst...

bug when using special token with uppercase

That does seem like a bug. Looking into how to fix that properly.

Error message not explicit

Would you be willing to open a PR for that ? :D

Updating safetensors version (fully backward compatible)

Also coming in a future release pretty soon some fix for torch==2.0 (bogus warning)

How can I know the progress of the model download?

`text-generation-server download-weights MODEL_ID` is probably what you're looking for. You can also add the progressbar back using the env variable `HF_HUB_ENABLE_HF_TRANSFER=0` (but download will be slower)

How can I know the progress of the model download?

Perfect. Closing this issue then.

inference through text-embeddings-inference server is slower than inference directly using model

It seems you are doing nothing in parallel, meaning every document is processed independantly. You are loosing on the batching aspect to speed things up here. Try sending requests in...