akaanupkumar

Results 23 comments of akaanupkumar

I was following your api instructions but then i got this error

Closing due to inactivity.

Llama 3

Llama 3 available in 0.5 version.

AssertionError: Config has to be initialized with question_encoder and generator config

Please verify pre-requisites and move to newly released 0.5 version. There is no such known issue in 0.5 version. let us know if you are facing issue on 0.5 version.

[BUG] Installing CLIP model breaks ChatRTX

Please verify pre-requisites and move to newly released 0.5 version. There is no such known issue in 0.5 version. let us know if you are facing issue on 0.5 version.

Build the Mistral TRT-LLM int4 AWQ Engine not working

Please verify pre-requisites and move to newly released 0.5 version. There is no such known issue in 0.5 version. let us know if you are facing issue on 0.5 version.

Reopen issue #90

Please try out the new 0.5 version ( link in readme and also available on NVIDIA App). Please let me know if any issues seen.

Invalid TensorRT-LLM Wheel File During Installation ERROR: Wheel 'tensorrt-llm' located at tensorrt_llm-0.9.0-cp310-cp310-win_amd64.whl is invalid.

We verify using venv. we have released 0.5 version. Please go through the pre-requisites mentioned in readme and give this version a try.

got an error when run chatrtx windows 10

We have released new 0.5 version. We have not observed such issue in 0.5 version. Please verify the prerequisites and give that a try.

"An error occured while downloading and installing dependencies"

Users have not reported this issue with latest 0.5 installer which is available on the link anujj shared above. Also the 0.5 version has been released here on github as...

"An error occured while downloading and installing dependencies"

Reopening the issue. We will need logs to understand the issue. Can you share the logs available in temp folder when you see the error? Example path for finding logs:...