jinholee-makinarocks

[FR] Support Optimum-wrapped models in MLflow transformers

4

### Issues Policy acknowledgement - [X] I have read and agree to submit bug reports in accordance with the [issues policy](https://www.github.com/mlflow/mlflow/blob/master/ISSUE_POLICY.md) ### Willingness to contribute Yes. I would be willing...

UnicodeDecodeError for grpcurl request with Bytes column in DataFrame

7

/kind bug **What steps did you take and what happened:** - deploy serving.kserve.io/v1beta1/InferenceService with custom container predictor - send grpc message with below command: [inputs_sample-3.json](https://github.com/user-attachments/files/15783785/inputs_sample-3.json) ```bash grpcurl --plaintext --proto serving-grpcapi.proto...

How to block to auto-scaling in specific situation

2

## Ask your question here: We use knative and kserve project in our product to provide inference services with auto-scaling. In some cases, we need to pause to the auto-scaling...

fail to log model by mlflow

2

### System Info ```shell python version : 3.9.16 mlflow: 2.4.2 transformers[torch] version : 4.31.0 optimum : 1.11.2 ``` ### Who can help? @philschmid , @JingyaHuang , @ec ### Information -...