Bob123Yang

rnnt complie error on TensorRT

2

Do full accuracy and performance runs for all the scenarios with below commands: **cmr "generate-run-cmds inference _submission _all-scenarios" --model=rnnt \ --device=cuda --implementation=nvidia-original --backend=tensorrt \ --execution-mode=valid --results_dir=$HOME/results_dir \ --category=edge --division=open --quiet**

CM running failed when cloning from https://github.com/GATEOverflow/inference_results_v4.0.git

5

I installed CM following the guide in https://docs.mlcommons.org/ck/install/ successfully and then refer to https://docs.mlcommons.org/inference/benchmarks/language/bert/ to run the scripts as below: cm run script --tags=run-mlperf,inference,_find-performance,_full \ --model=bert-99 \ --implementation=nvidia \ --framework=tensorrt...

Fail to build and launch the docker in closed/NVIDIA folder

5

After installing the docer engine and the NVIDIA Container with rootless mode configured, and then clone mlcommons/inference_results_v4.0.git and configure the MLPERF_SCRATCH_PATH, and start to build and launch a docker container...

Terminal disppeared after rnnt inference running without any error (attach log)

3

I'm trying to run the rnnt inference on mlperf4.0 with the below commands and after a long time the whole terminal will disppear without any error prompt. I'm not sure...

Fail to build the docker with rootless user

20

Run the below cm commands for several times and always failed at the same place: (cm) tomcat@tomcat-Dove-Product:~$ cm run script --tags=run-mlperf,inference,_find-performance,_full,_r4.1-dev \ --model=resnet50 \ --implementation=nvidia \ --framework=tensorrt \ --category=edge \...

[Question]: How to login RAGFlow from another system.

6

### Self Checks - [x] I have searched for existing issues [search for existing issues](https://github.com/infiniflow/ragflow/issues), including closed ones. - [x] I confirm that I am using English to submit this...

[Question]: Table parsing got 31 chunks (one chunk = one entry/issue) but chat answer can only display 7 entries for the whold table

10

### Self Checks - [x] I have searched for existing issues [search for existing issues](https://github.com/infiniflow/ragflow/issues), including closed ones. - [x] I confirm that I am using English to submit this...

[Question]: RAGFlow failed to connect to the local Ollama model

7

### Self Checks - [x] I have searched for existing issues [search for existing issues](https://github.com/infiniflow/ragflow/issues), including closed ones. - [x] I confirm that I am using English to submit this...

[Question]: ragflow is still running on CPU even use the command "docker compose -f docker-compose-gpu.yml up -d"

3

### Self Checks - [x] I have searched for existing issues [search for existing issues](https://github.com/infiniflow/ragflow/issues), including closed ones. - [x] I confirm that I am using English to submit this...

The test result for the inference on 3d-unet-99 model seems abnormal.

1

Hi @arjunsuresh, it's successful to build the docker container by running the be below command but still report the errors pasted **at the end.** mlcr run-mlperf,inference,_find-performance,_full,_r5.0-dev \ --model=3d-unet-99 \ --implementation=nvidia...