Ciro Cavani comments

Results 5 comments of


                                            Ciro Cavani

Error when reading csv in non UTF-8 encoding

I had the same problem. Maybe update the examples? CSV.File docstring already suggest similar work around: https://csv.juliadata.org/stable/reading.html#CSV.File > For text encodings other than UTF-8, load the [StringEncodings.jl](https://github.com/JuliaStrings/StringEncodings.jl) package and call...

`HUGGING_FACE_HUB_TOKEN` not exported in Sagemaker entrypoint

Hi @mspronesti I am guessing, it seems that the launcher get the access token from a environment variable. Have you tried `HF_API_TOKEN` ? https://github.com/huggingface/text-generation-inference/blob/v0.8.2/launcher/src/main.rs#L583-L586 ```python # TGI config config =...

Sagemaker entrypoint HF_MODEL_TRUST_REMOTE_CODE in config doesn't get recognized

hi, I had the same problem. Version 0.8.2 does not have HF_MODEL_TRUST_REMOTE_CODE in entrypoint script. https://github.com/huggingface/text-generation-inference/blob/v0.8.2/sagemaker-entrypoint.sh A workaround is to set TRUST_REMOTE_CODE=true directly (text-generation-laucher will pick this environment variable). https://github.com/huggingface/text-generation-inference/blob/v0.8.2/launcher/src/main.rs#L74-L78...

Sagemaker entrypoint HF_MODEL_TRUST_REMOTE_CODE in config doesn't get recognized

The other option is to use the latest TGI and remove TRUST_REMOTE_CODE. SageMaker SDK 2.171 still has version 0.8.2. https://github.com/aws/sagemaker-python-sdk/blob/v2.171.0/src/sagemaker/image_uri_config/huggingface-llm.json The latest release in this repo is 0.9.1. https://github.com/huggingface/text-generation-inference/pkgs/container/text-generation-inference/107426365?tag=0.9.1 In...

Sagemaker entrypoint HF_MODEL_TRUST_REMOTE_CODE in config doesn't get recognized

@yapweiyih I am guessing, what files do you have in MERGE_MODEL_DIR? are they all local files or any of them is a symlink to a file in the cache? I...