lishuang

when I use custom dataset to train CenterNet2_R2-101-DCN-BiFPN_1280_4x ,the project is break.

6

```shell File "/home/lishuang/Disk/gitlab/traincode/CenterNet2/projects/CenterNet2/centernet/modeling/backbone/bifpn_fcos.py", line 240, in forward raise NotImplementedError() NotImplementedError ``` h =1 target_h =1 w =2 target_w =1 How to deal with it?

``` UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()`. In PyTorch 1.1.0 and later, you should call them in the opposite order: `optimizer.step()` before `lr_scheduler.step()`. Failure to do this will result...

Cannot build r22.03 onnxruntime_backend with tensorrt

2

**Description** I was unable to build the onnxruntime_backend with OpenVino for Triton Inference Server r22.03 using compatible ONNXRuntime and tensorrt versions (from Triton Inference Server compatibility matrix). **Triton Information** r22.03...

Build via Docker is much big than the image in NGC

5

TensorRT-LLM Backend I have built via docker. But the size of docker image is too big than the image in NGC. How to decrease the size?  this is the...

容器启动xinference和openwebui发生冲突

5

### System Info / 系統信息 registry.cn-hangzhou.aliyuncs.com/xprobe_xinference/xinference:v0.14.0.post1镜像 ### Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？ - [X] docker / docker - [ ] pip install / 通过 pip install...

如何在容器中使用xinference-worker进行部署

17

通过容器启动supervisor ```shell docker run -v ./xinfer_supervisor:/tmp/xinference --name xinfer_supervisor \ -e XINFERENCE_HOME=/tmp/xinference -e XINFERENCE_MODEL_SRC=modelscope \ -p 9997:9997 -p 9996:9996 xprobe/xinference:v0.13.2 \ xinference-supervisor -H 0.0.0.0 -p 9997 --supervisor-port 9996 --log-level debug ```...

can not run whisper on T4

4

### System Info x86_64 755G nvidia T4 ubuntu 22.04 trtllm version : https://github.com/NVIDIA/TensorRT-LLM/archive/9691e12bce7ae1c126c435a049eb516eb119486c.zip pip install tensorrt-llm==0.11.0.dev2024062500 --extra-index-url https://pypi.nvidia.com ### Who can help? @Tracin ### Information - [X] The official example...