Mustapha Unubi Momoh

@teis-e have you tried building using the docker image provided? Building on bare windows never worked for me. Check out the instructions on the `rel` branch to build with docker...

> No I haven't yet. I will try that. > > Will that give me the option to build the TRT engine's as well? Once you've built and installed the...

You should build the wheel in the container, then install the built wheel on your PC. First, make sure to mount a folder from your PC in the container. Once...

> I understand now. > > Altought running: `docker build --no-cache -t tensorrt-llm-windows-build:latest .` > > Hangs here for already 20 minutes, is this normal?: > > ``` > Sending...

On Windows (Docker). Following the instructions here, I didn't encounter any issues building the wheel: ensure to use the `rel` branch: `git clone --branch https://github.com/NVIDIA/TensorRT-LLM.git`. Let me know if you...

Hi @byshiue The batch manager static lib for windows is missing in this branch. I have attached screenshots below. It is available in the `rel` branch but missing in `main`....

> Hi! This error is thrown from third party libraries. A quick google search revealed that others had similar issues in other repos with gradio demos. This here seems a...

Thanks @evonneng I tried with a 12 secs (i.e.

Hi @chrisbward did the issue eventually resolve? In my case, I first got the 'Boolean value of Tensor with more than one value is ambiguous' error originally but it resolved...

@anujj Installing tensorrt_llm version 0.5 i.e. `pip install tensorrt_llm==0.5 --extra-index-url https://pypi.nvidia.com/ --extra-index-url https://download.pytorch.org/whl/cu121` results in the error: ``` ERROR: No matching distribution found for torch==2.1.0.dev20230828+cu121 ``` Here is the full...