Jiayu Chang issues

Repositories
Issues
Comments

Results 1 issues of


                                            Jiayu Chang

[https://nvbugs/5322131][feat] Multi-LoRA serving with CUDA Graph

# NvBug https://nvbugspro.nvidia.com/bug/5322131 https://nvbugspro.nvidia.com/bug/5441746 # Benchmark Perf merge base `43c46a09` | | Avg ITL (ms) | Throughput (tok/s) | Avg TTFT (ms) | |--------|--------|--------|----------| | CUDA Graph + multi LoRA...