Bob123Yang

Fail to run the 3d-unet-99 with error "No matching distribution found for nvidia-nvcomp-cu12" after my mlc upgrade.

1

Fail to run the 3d-unet-99 with error "No matching distribution found for nvidia-nvcomp-cu12" after my mlc upgrade. mlcr run-mlperf,inference,_find-performance,_full,_r5.0-dev \ --model=3d-unet-99 \ --implementation=nvidia \ --framework=tensorrt \ --category=edge \ --scenario=Offline \...

Seems not support running mlc inferenece on multiple GPUs?

2

Hi @arjunsuresh, it's successful to build the docker container by running the be below command but still report the errors. mlcr run-mlperf,inference,_find-performance,_full,_r5.0-dev \ --model=retinanet \ --implementation=nvidia \ --framework=tensorrt \ --category=edge...

Fail to build the docker for mlc command on Ubuntu 22.04

7

I failed to run the mlc command on Ubuntu 22.04: mlcr run-mlperf,inference,_find-performance,_full,_r4.1-dev \ --model=resnet50 \ --implementation=nvidia \ --framework=tensorrt \ --category=edge \ --scenario=Offline \ --execution_mode=test \ --device=cuda \ --docker --quiet \...

Save the docker with Resnet50 running successfully and load it on another system with the same config but fail to run Resnet50

1

Hi @arjunsuresh I have encountered one issue for the docker migration. I run the below command in the system A to build the docker successfully and run the Resnet50 inference...

Fail to build the GPT-J docker after successfully installation of tensorrt-llm

2

Hi @arjunsuresh When I was running the below command to build the docker for GPT-J: cm run script --tags=run-mlperf,inference,_find-performance,_full,_r5.0-dev \ --model=gptj-99 \ --implementation=nvidia \ --framework=tensorrt \ --category=edge \ --scenario=Offline \...

why did the specified data precision not work for MLPerf inference?

4

Run Resnet50 without the precision parameter in the docker successfully and get the result (measurements.json) that displays data type is int8. Then run Resnet50 again with the precision=float16 as below...

CM script failed to run harness after docker done

2

Hi @arjunsuresh **I am running the Resnet50 benchmark with the command:** cm run script --tags=run-mlperf,inference,_find-performance,_full,_r4.1-dev \ --model=resnet50 \ --implementation=nvidia \ --framework=tensorrt \ --category=edge \ --scenario=Offline \ --execution_mode=test \ --device=cuda \...

### Reminder - [x] I have read the above rules and searched the existing issues. ### System Info I use Llama-factory v0.9.4.dev0 to fine tune Qwen3-4B-Instruct-2507 with Lora, but failed...

[Question]: RAGFlow Chat assistant seems unstable and find nothing in the beginning of chatting.

13

### Self Checks - [x] I have searched for existing issues [search for existing issues](https://github.com/infiniflow/ragflow/issues), including closed ones. - [x] I confirm that I am using English to submit this...

[Bug]: web dead after the query submitted for V0.22.1

4

### Self Checks - [x] I have searched for existing issues [search for existing issues](https://github.com/infiniflow/ragflow/issues), including closed ones. - [x] I confirm that I am using English to submit this...