seungrokj

[Documentation]: add MI300 series support on the dockerhub Overview

2

### Description of errors https://hub.docker.com/r/rocm/pytorch Can you please add this ? Many are confused as the Overview does not contain mi300 series information. **Starting from ROCm6.0, the "latest" tag docker...

MODEL_ID propagation fix

2

Hi, This is to fix the bug here: File "/opt/conda/lib/python3.10/site-packages/text_generation_server/models/flash_causal_lm.py", line 1160, in warmup f"tunableop_{MODEL_ID.replace('/', '-')}_tp{self.world_size}_rank{self.rank}.csv", MODEL_ID is not properly propaged. Please review this @OlivierDehaene @Narsil Regards, Seungrok

[Bug] DeepSeek-V3 an illegal memory access was encountered

4

### Checklist - [ ] 1. I have searched related issues but cannot get the expected help. - [ ] 2. The bug has not been fixed in the latest...