serve

serve copied to clipboard

Add issue alert on failed scheduled GHA

1

## Description Adds an alert on failed Github scheduled Github Action. This is the exact same trick used in [pytorch/examples ](https://github.com/pytorch/examples) Code borrowed from: https://github.com/pytorch/examples/blob/main/.github/workflows/main.yml#L34 And a test showing it...

msaroufim

Gracefully handle decoding exceptions in python backend

2

Fixes https://github.com/pytorch/serve/issues/1776 Test: https://colab.research.google.com/drive/1eKMiheF50YYGtPmi0WqVkeRqLk8Gbwg5?usp=sharing (would probably be better to start writing unit tests for the python backend when we have time) The meaningful code is at the very end of...

msaroufim

Fix an erroneous logging format string and pylint pragma

1

## Description This pull request fixes an incorrect logging format string and a pylint pragma that incorrectly disables its warning it. I noticed this issue when using TorchServe's profiling mechanism...

bradlarsen

deprecate ci benchmark dir

1

## Description Please read our [CONTRIBUTING.md](https://github.com/pytorch/serve/blob/master/CONTRIBUTING.md) prior to creating your first pull request. Please include a summary of the feature or issue being fixed. Please also include relevant motivation and...

lxning

[RFC]: Metrics Refactoring

12

### Current TorchServe has two mechanisms to emit metrics. 1. [Emit metrics to logs files in a StatsD like format by default](https://github.com/pytorch/serve/blob/master/docs/metrics.md#formatting) . In this case, both frontend and backend...

lxning

fix: model status API for kserve

2

Signed-off-by: jagadeesh ## Description fixes: [kserve/kserve-1915](https://github.com/kserve/kserve/issues/1915) Issue: kserve model status API returns ready status only after a predict request as model is not loaded in startup. Soln: Loads all TS...

jagadeeshi2i

Deprecate neuron Dockerfile in favor in DLC

3

This change is to deprecate neuron dockerfile as it is currently broken. Instead, it's ideal at this to point use containers provided by [aws/deep-learning-containers](https://github.com/aws/deep-learning-containers/blob/master/available_images.md#neuron-inference-containers) that are more reliable. I also...

rohithkrn

load_models all loading the same model 10 times before going unresponsive

8

### 🐛 Describe the bug This is a continuation of #1779 as that discussion took a different route. ### Error logs [Logs too long, moved to pastebin](https://pastebin.com/mGe5JLYW) ### Installation instructions...

ridhwan-saal

Handler to input/output wav file

4

I am asking again because the Issue(#1777 ) is not reopen. I have created a custom handler based on the documentation. However, it is not working well. Below is the...

Shin-ichi-Takayama

page not found!

1

### 📚 The doc issue https://github.com/pytorch/serve/blob/master/docs/model-archiver/README.md ### Suggest a potential alternative/fix _No response_

moghadas76