alexhegit

root@8f88fbfbe029:/data/repo/test# python classify-samples.py -c /root/caffe/ -m epoch_30/ -d untrained-samples/ Traceback (most recent call last): File "classify-samples.py", line 113, in main() File "classify-samples.py", line 95, in main classifier = ImageClassifier(model_dir) File...

### Is your feature request related to a problem? Please describe. 比如针对一个GPU0为6GB显存，GPU1为12GB显存的双GPU推理示例代码。 ### Solutions 我的示例代码如下（调试成功） Thu Jun 22 11:43:34 2023 +---------------------------------------------------------------------------------------+ | NVIDIA-SMI 536.23 Driver Version: 536.23 CUDA Version: 12.2...

Update to ROCm5.7 and PyTorch

30

The webui.sh installs ROCm5.4.2 as default. The webui run failed with AMD Radeon Pro W7900 with **Segmentation Fault** at Ubuntu22.04 maybe the ABI compatibility issue. ROCm5.7 is the latest version...

Enable AMD iGPU 780M in Linux, Create amd-igpu-780m.md

6

Add tutorial to run Ollama with AMD iGPU 780M (of Ryzen 7000s/8000s CPU) in Linux.

How to use llmperf to test ollama performance (TTFT, etc)

1

Hello, How to use llmperf to test ollama performance (TTFT, etc)? Thanks, Alex