wenzhaojie

feat: support dynamic configuration for dynamic batching without service restart

1

### Describe the feature We can set parameters such as num=1, max_batch_size=4, max_wait_time=10 within append_worker(). However, we cannot modify these parameters during the service's runtime. Is it possible to provide...

[Feature Request] Support Loading Moirai Model from Local Checkpoint for Inference

1

**Is your feature request related to a problem? Please describe.** I am frustrated that there is no standard or convenient way to load a Moirai model from a locally trained...

**What happened**: After a GPU node (`x99`) was manually powered off and then restarted, a Pod requesting partial GPU cores and memory remained stuck in the `Pending` state. The Pod...