Mustapha Unubi Momoh
Mustapha Unubi Momoh
First, I would like to thank you for the incredible project and for making it public. My issue is after recording the audio and hitting the submit button, I run...
The bindings module is missingit seems. This results in an error when I run the command to build the TRT engine based on the instruction in the readme > For...
When I run the command to start the application, I get the version mismatch error: The command: ``` python app.py --trt_engine_path model/ --trt_engine_name llama_float16_tp1_rank0.engine --tokenizer_dir_path Llama-2-13b-chat-hf --data_dir dataset/ ``` The...
### System Info - CPU architecture: x64 - GPU: RTX 4090 24G - CUDA 12.2 ### Who can help? @byshiue @nc ### Information - [X] The official example scripts -...
add `--branch rel` to `git clone https://github.com/NVIDIA/TensorRT-LLM.git` to clone the `rel` branch instead of `main`
The setup script for windows is located in `./windows/....` Inorder to run the script users need to: 1. Navigate to the cloned repo: ``` cd TensorRT-LLM ``` 2. Run the...
Device: Win 11; RTX 4090 When I run: `make -C docker release_build` it fails with the error below. ``` make: Entering directory '/home/mustapham/TensorRT-LLM/docker' Building docker image: tensorrt_llm/release:latest DOCKER_BUILDKIT=1 docker build...
### Describe the bug I need help with this recursion error `maximum recursion depth exceeded` from *boto3*. This occurs when I initialize an s3 client in my inference script to...
Hi, I tried running the `surya_gui` command as instructed in the readme. However, l keep getting the OSError. ``` OSError: We couldn't connect to 'https://huggingface.co' to load this file, couldn't...